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Abstract 


We present new and efficient parallel algorithms for generation of combinatorial objects. 
The combinatorial objects we generate include permutations, combinations and derange- 
ments. Our algorithms can be categorized based on time into two types: linear time 
and poly-logarithmic. The tool that enables the linear time algorithms is the concept of 
Combinatorial tree. The poly-logarithmic time algorithms are derived using divide and 
conquer paradigm. In general our algorithms can be looked at as giving algorithmic 
interpretation to well known combinatorial identities. The abstract models of parallel 
computation used are members of the Parallel random access machine (PRAM) family. 
The results are summarized below, grouped according to problems. 

Permutations: New efficient algorithms for generation of all r-permutations of n distinct 
objects are presented. We present four basic algorithms for the generation of permuta- 
tions. The first algorithm is cost optimal for generating r-permutations in lexicographic 
order with time complexity 0{r) on CREW PRAM. It is based on building a permutation 
tree. This algorithm is marked for its simplicity when compared to the existing algorithms. 
The second algorithm generates all the r-permutations of n objects with a time complex- 
ity of O(logn) and a cost of 0(r log rP(n, r)) on EREW PRAM. This algorithm also 
runs with a time of O(logn) and work of 0(r log log rP[n,r)) on ARBITRARY CRCW 
PRAM. An extension of this algorithm for lexicographic generation of permutations runs 
with time O(logra) and work of 0(r logrP(n,r)) but on CREW PRAM. We also discuss 
the randomized and non-conservative variants of this algorithm; these variations are op- 
timal and run with a time complexity of O(logn). We later obtained an optimal version 
of this algorithm which generates r-permutations in lexicographic order on EREW PRAM 
in O(logra) time with 0(rP(n,r)) work. The third algorithm generates r-permutations 
lexicographically with a time complexity of O(logr(logr + loglog*n)) with optimal work 
0(rP(n,r)) on CREW PRAM. This algorithm can also be implemented to work with 
a time complexity of 0(logr(logr + a(n))) with optimal work on COMMON CRCW 
PRAM. The fourth algorithm runs with a time of 0(log n) with optimal work on CREW 
PRAM. The last two algorithms are designed based on divide-and-conquer paradigm. 
Combinations: We present three optimal algorithms for the lexicographic generation of 
r-combinations of n distinct objects. The first algorithm runs with a time complexity 
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of 0(r ) and optimal work 0(rC(n,r )) on CREW PRAM and is based on building 
a combination tree. The second algorithm has a time complexity of 0(logr(logr + 
log log *n)) on CREW PRAM and 0(logr(logr + a(n)) on COMMON CRCW PRAM 
and is based on divide and conquer on the parameter r. The third algorithm runs with a 
time of (9(logre) on CREW PRAM and is based on divide and conquer on the parameter 
n. 

Derangements: We present new, efficient and optimal parallel algorithms for the gen- 
eration of derangements. The first algorithm runs in 0(n ) time with optimal work 
0{nD(n )) on CREW PRAM. This is based on building a derangement tree. We present 
a novel method to show that given an 0(T) time and O(W) work algorithm for lexico- 
graphic generation of all permutations of n objects, we can automatically generate all 
derangements of n objects in 0(T + log n) time with 0(W) work on the same model on 
which permutation generation algorithm runs. This results in an O(logn) time 0(nD(n )) 
optimal work algorithm for lexicographic generation of derangements on EREW PRAM. 
These improvements are a result of a ranking function, designed for derangement. The 
ranking function is also of independent interest. We discuss parallelization of ranking 
function on EREW and CREW PRAMs. 


3 



Contents 


Acknowledgments iij 

1 Introduction 4 

1.1 Combinatorial Generation 4 

1.2 Parallel Computation Models 8 

1.3 Preliminaries 9 

1.4 Organization of Thesis 10 

2 Basics 11 

2.1 Standard Techniques 11 

2.2 Standard Procedures 14 

2.2.1 Ranking of Permutation 14 

2.2.2 Ranking of Combination 15 

2.3 Generic Processor Allocation Problem 16 

3 Faster Optimal Parallel Algorithms for the Generation of Permutations 19 

3.1 Introduction 19 

3.1.1 Preliminaries 20 

3.2 The r-Recursive Algorithm 21 

3.2.1 Basic Algorithm 21 

3.2.2 Generalization of the Algorithm 31 

3.3 The n-Recursive Algorithm 37 

3.3.1 Basic Algorithm 38 

3.3.2 Generalization of the Algorithm 52 


IV 



3.4 Conclusions 


62 


4 Efficient Parallel Algorithms for Generation of Permutations 63 

4.1 Introduction 63 

4.2 Basic Algorithm 63 

4.2.1 Permutation Tree 64 

4.2.2 Algorithm 64 

4.3 Logarithmic Time Algorithm for n-permutations of n objects 67 

4.3.1 Basic Idea 70 

4.4 Logarithmic Time Algorithm 74 

4.4.1 Basic Idea 74 

4.4.2 Generating permutations Lexicographically 76 

4.5 Relationship between generation of permutations and parallel integer sorting 76 

4.6 Conclusions 80 

5 Making Permutation Generation Optimal 81 

5.1 Algorithm 81 

6 Faster Optimal Algorithms for Generation of Derangements 84 

6.1 Introduction 84 

6.1.1 History and Related Work 85 

6.1.2 Preliminaries 85 

6.1.3 Notation 86 

6.1.4 Organization of the Chapter 86 

6.2 The 0(n ) Time Algorithm 86 

6.2.1 Algorithmic Interpretation 86 

6.2.2 Derangement Tree 87 

6.2.3 Algorithm 89 

6.3 Ranking 92 

6.4 Implementation of Ranking function 94 

6.4.1 Pre-Processing 95 

6.4.2 The EREW Implementation 96 

6.4.3 The CREW Implementation 97 



6.5 Derangements from Permutations 99 

6.5.1 Description of Algorithm 100 

7 Faster Optimal Parallel Algorithms for the Generation of Combinations 102 

7.1 Introduction 102 

7.1.1 History and Related Work 103 

7.1.2 Preliminaries 103 

7.2 0(r ) Time Algorithm 104 

7.2.1 Algorithmic Interpretation 104 

7.2.2 Combination Tree 105 

7.2.3 Algorithm 106 

7.2.4 Proof of Correctness 107 

7.2.5 Analysis 109 

7.3 The r-Recursive Algorithm 110 

7.3.1 Basic Algorithm 110 

7.3.2 Generalization of the Algorithm 123 

7.3.3 Generalization of the Algorithm (Case r > [|]) 126 

7.4 The n-Recursive Algorithm 128 

7.4.1 Basic Algorithm 128 

7.4.2 Generalization of the Algorithm 140 

7.4.3 CASE r > f 147 

7.4.4 Generation of Combinations Lexicographically 147 

8 Conclusions 148 


vi 



Chapter 1 
Introduction 


In recent years there has been tremendous effort on the part of researchers throughout 
the world to develop fast and efficient parallel algorithms. The reason for this urgency 
is, that sequential machines are reaching their limits in terms of their computing power. 
It appears parallel model of solving problems is the only practical approach to meet 
the computing needs of the coming generation. In accordance with this idea, parallel 
computers have been built. More over, the parallel computers are becoming more and 
more feasible and lack of efficient parallel algorithms may become a bottleneck for their 
commercial use. The work described in this thesis conforms with the general goal of 
developing fast and efficient algorithms. We propose new efficient parallel algorithms for 
generation of combinatorial objects. 

1.1 Combinatorial Generation 

The systematic generation of combinatorial objects is a fundamental problem in combinat- 
orial computation. The enumeration of combinatorial objects occupies an important place 
in computer science due to its many applications in science and engineering[3, 30, 31]. 
They have applications in the design of other algorithms like subset-sum, knapsack and 
base-enumeration problems[15]. In this thesis we present parallel algorithms for the gen- 
eration of r-permutations, r-combinations and derangements for distinct objects. We 
assume those distinct objects to be the first n positive integers. 

We begin with some definitions. Let S be a set consisting of n distinct items, say, 
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the first n positive integers. So, S — {1,2, . . . )n j. p or our purposes, a combinatorial 
object can be considered as an ordered selection of some integers out of S. 

Now, let x = (x\x 2 . . . x r ) and y = (yiy 2 . . .y r ) be two combinatorial objects of S. 
We say that x precedes y in lexicographic order if either < y x or if there exists an 
integer i, 1 < i < r, such that xj = % for all j < { an d x { < y { . 

Based on the above definition, combinatorial objects can be ordered in lexicographic 
order. So, each combinatorial object of a given length has an associated index in lex- 
icographic order. By ranking we mean getting this index of an arbitrary combinatorial 
object. Similarly, unranking means getting the combinatorial object given its index in 
lexicographic order. So, unranking is the inverse operation of ranking. 

Permutations 

An r-permutation of S is obtained by selecting r distinct integers out of S and arranging 
them in some order. Thus, for example, for n — 10 and r — 4, a 4-permutation might 
be (5 7 9 3). Two r-permutations are different (or distinct) if they differ either with 
respect to the items they contain or with respect to the order of the items. The number 
of distinct r-permutations of n items is denoted by P(n,r), where P(n,r) = ^ — - . 
Thus, for n = 4, there are twenty four distinct 3-permutations. In the special case, 
where r = n, P[n,n) = n!. 

The 3-permutations of {1,2,3, 4} in lexicographic order are shown below: 

(1 2 3), (1 2 4), (1 3 2), (1 3 4), 

(1 4 2), (1 4 3), (2 1 3), (2 1 4), 

(2 3 1), (2 3 4), (2 4 1), (2 4 3), 

(3 1 2), (3 1 4), (3 2 1), (3 2 4), 

(3 4 1), (3 4 2), (4 1 2), (4 1 3), 

(4 2 1), (4 2 3), (4 3 1), (4 3 2). 

Since there are P(n,r) r-permutations, each of length r, permutation generation has 
a trivial lower bound of fl(P(n,r)r). 

The current best parallel algorithm for the generation of r-permutations runs with a 
time complexity of 0(r) and is cost optimal[34]. This algorithm does not produce the 
permutations in lexicographic order. 

We present new efficient parallel algorithms for generation of all r-permutations of n 
distinct objects. We present four basic algorithms for the generation of permutations in 
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Chapters 3, 4 and 5. The first algorithm is cost optimal for generating r-permutations in 
lexicographic order with time complexity 0{r ) on CREW PRAM. It is based on building 
a permutation tree. This algorithm is marked for its simplicity when compared to the 
existing algorithms. The second algorithm generates all the r-permutations of n objects 
with a time complexity of C*(logn) and a cost of 0(P(n, r)r log r) on EREW PRAM. 
This algorithm also runs with a time of O(logn) and work of 0(P(n, r)rloglogr) on 
ARBITRARY CRCW PRAM. An extension of this algorithm for lexicographic generation 
of permutations runs with time 0(logn) and work of 0(P(n, r)r log r) but on CREW 
PRAM. We also discuss the randomized and non-conservative variants of this algorithm; 
these variations are optimal and run with a time complexity of O(logn). We later discuss 
an optimal version of this algorithm which generates r-permutations in lexicographic 
order in O(logn) time with 0(rP(n,r)) work on EREW PRAM. The third algorithm 
generates r-permutations lexicographically with a time complexity of 0(logr(logr + 
log log *n)) with optimal work <3(P(n,r)r) on CREW PRAM. This algorithm can also 
be implemented to work with a time complexity of O(logr(log r + a(n ))) with optimal 
work on COMMON CRCW PRAM. The fourth algorithm runs with a time of O(logn) 
with optimal work on CREW PRAM. The last two algorithms are designed based on 
divide-and-conquer paradigm. 

Combinations 

An r-combination of S is obtained by selecting r distinct integers out of S and arranging 
them in increasing order. Thus for n = 6 and r = 3, one 3-combination is (2 4 6). Two 
r-combinations are distinct if they differ with respect to the items they contain. The 
number of distinct m-combinations of n items is denoted by C{n,m), where C(n,m ) = 

n? 

(n— m)!m! * 

Thus for n = 4, there are four distinct 3-combinations. In the special case where 
r = n, C(n,n) = 1. 

The 3-combinations of {1,2, 3, 4} in lexicographic order are; 

(1 2 3), (1 2 4), (1 3 4), (2 3 4). 

Since there are C(n,r) r-combinations, each of length r, combination generation has 
a trivial lower bound of H(C(n,r)r). 
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The current best parallel algorithm for the generation of r-combinations in lexico- 
graphic order runs with a time complexity of 0(r ) and is cost optimal[34]. 

We present three optimal algorithms for the lexicographic generation of r-combinations 
of n distinct objects in Chapter 7. The first algorithm runs with a time complexity of 0(r ) 
and optimal work 0(C(n,r)r) on the CREW PRAM and is based on building a combin- 
ation tree. The second algorithm has a time complexity of <9(logr(logr + loglog*n)) 
on CREW PRAM and 0(logr(logr + a(n)) on COMMON CRCW PRAM and is based 
on divide and conquer on the parameter r. The third algorithm runs with a time of 
O(logn) on CREW PRAM and is based on divide and conquer on the parameter n. 
Derangements 

A derangement of S is defined as a permutation P of these integers which changes every 
element so that no integer appears in its natural position. Formally, if P is the ordered 
n-tuple ( pip 2 . . . p n ) then P is a derangement of {1,2,.. . ,n} provided that pi ^ i for 
all i, 1 < i < n. The number of derangements of n objects is denoted by D(n). D(n ) 
satisfies the recurrence relation 

D{n) = (n - l){D{n - 1) + D(n - 2)) (1.1) 

with £>(0) = 1 and D( 1) = 0. 

For example, there are nine derangements for n = 4, namely 
(2 1 4 3), (2 3 4 1), (2 4 1 3), (3 1 4 2), 

(3 4 1 2), (3 4 2 1), (4 1 2 3), (4 3 1 2), 

(4 3 2 1) 

Since there are D(n ) derangements, each of length n, derangement generation has 
a trivial lower bound of f 1(D(n)n). 

The current best parallel algorithm[23] for derangements runs with a time complexity 
of 0(n log n) with 0{nD{n) log n) work. Obviously this algorithm is not cost optimal. 

We present new, efficient and optimal parallel algorithms for the generation of de- 
rangements in Chapter 6. The first algorithm runs in 0(n ) time with optimal work 
0(D(n)n ) on CREW PRAM. This algorithm is based on the concept of derangement 
tree. We present a novel method to show that given an 0(T) time and 0(W) work 
algorithm for lexicographic generation of all permutations of n objects, we can automat- 
ically generate all derangements of n objects in 0(T + log n) time with 0{W) work 
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on the same model on which permutation generation algorithm runs. This results in 
an O(logn) time 0{nD(n )) optimal work algorithm for lexicographic generation of de- 
rangements on EREW PRAM. These improvements are a result of a ranking function, 
we designed for derangement. The ranking function is also of independent interest. We 
discuss parallelization of ranking function on EREW and CREW PRAMs. We can rank 
a derangement in O(logn) time with 0(n 3 ) work on EREW PRAM. We can rank a 
derangement in O(logn) time with O(nlogn) work on CREW PRAM. 

1.2 Parallel Computation Models 

We will be using the Parallel Random Access Machine(PRAM) model[17]. In this model, 
processors are numbered 1,2 ...,p and various cells in the common shared memory 

are numbered 1,2, Each processor knows its own number. In PRAM basic model 

itself there are different models depending on the reading and writing of memory access 
strategies. They are given below: 

1. Exclusive-Read, Exclusive-Write(EREW): Access to memory locations is ex- 
clusive. In other words, no two processors are allowed simultaneously to read or 
write into the same memory location. 

2. Concurrent-Read, Exclusive-Write(CREW): Multiple processors are allowed 
to read the same memory location simultaneously. But more than one processor 
writing into the same memory location simultaneously is forbidden. 

3. Concurrent-Read, Concurrent-Write(CRCW): More than one processor are 
allowed to read and write into the same memory location simultaneously. Concur- 
rent write is not immediately meaningful. A sub-classification with respect to the 
conflict resolution strategy based on the values written is standard. 

(a) COMMON CRCW: All the processors simultaneously writing into the same 
location must write the same value. 

(b) ARBITRARY CRCW: If more than one processor are writing into the same 
memory location simultaneously, then one among them succeeds but no guar- 
antee is given as to the identity of the successful processor. 
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(c) PRIORITY CRCW: The smallest indexed processor succeeds when multiple 
processors are simultaneously writing into the same location. 

A parallel algorithm running with P processors for a time T is said to do a work (or 
has a cost ) of TP operations. If this work is within a constant multiple of the lower 
bound for the sequential algorithm, then the parallel algorithm is said to be optimally 
efficient or optimal[ 29, 25, 18]. A primary goal in parallel computation is to design 
optimally efficient algorithms that run as fast as possible. Our algorithms in this report 
are optimal according to this criterion. 

We will be frequently using the concept of self simulation of PRAM in the design 
of our algorithms. A PRAM model is said to be self-simulating if an algorithm which 
takes a time of f t - units with pi processors can also be implemented on that model in 
OiriU ) time with processors. The PRAM models we use in this thesis are known to 
be self-simulating. 

1.3 Preliminaries 

We express the time complexity of our algorithms in terms of the order notation defined 
below: 

Definition: f(n ) = 0(g(n )) if and only if there exists positive integer constants c and 
no such that f(n ) < cg(n ) for all n > n 0 . 

Definition: f(n ) = fl(g(n)) if and only if there exists positive integer constants c and 
no such that /(n) > cg(n ) for all n > no- 

Definition: /(n) = 0(g(n)) if and only if /(n) = 0(g(n )) and g(n ) = 0(/(n)). 
Definition: /(n) = u(g(n)) if and only if for all positive c > 0, there exists positive 
integer constant n 0 such that /(n) > cg(n) for all n > n 0 

We define below two other mathematical functions which are useful in our algorithms. 
Consider 

lo («) n _ ( log(log (,_1) n) if * > 1. 

° S U \ n if i = 0. 

Then log-'n is defined as shown below. 
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Note that, 


log* n = min{i\ log^ n < 1} 


( 1 . 2 ) 


log*(n r ) = 0(log* n + log* r) (1.3) 

if r < n. 

Similarly, Ackermann’s function is defined as shown below. 

' 2 j if * = 1 

®(*>j) = < a(i — 1,2) if j = 1 

k a(i-l,o(t,j-l)) if ij > 2 
The inverse Ackermann’s function is defined as shown below 

a{n) = min{j\a(j,j) > n} (1.4) 

Note that 

a(n r ) == 0(a(n) + a(r)) (1.5) 

if r < n. 

Both the functions, Inverse Ackermann and log*n, are extremely slow growing func- 
tions. 

1.4 Organization of Thesis 

The rest of the thesis is organized as follows. In Chapter 2, we list and discuss some basic 
parallel algorithms and techniques that are used in later chapters. We discuss optimal 
algorithms to generate permutations in Chapter 3. Chapter 4 presents efficient parallel 
algorithms for generation of permutations on a weaker model (EREW). We discuss an 
approach to make a given non-optimal algorithm optimal for permutation generation 
in Chapter 5. This approach works for a particular class of permutation generation 
algorithms. Fast parallel algorithms for generating derangements appear in Chapter 6. 
We discuss optimal parallel algorithms for generating combinations in Chapter 7. We 
end the report with concluding remarks which include some suggestions for further work. 
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Chapter 2 
Basics 


In this chapter we will look at the basic techniques and problems that are frequently 
used in later chapters. We will define the problems and the results associated with the 
algorithms for them. 

2.1 Standard Techniques 

In this section we will review parallel algorithmic techniques and certain basic problems 
that frequently arise in later chapters (and in many other parallel algorithms). 

Prefix Computation 

Consider the sequence of n elements {sx, x 2 , . . . , x n } from a set S on which a binary 
associative operator ‘(8)’ is defined. The problem of prefix computation is defined as the 
finding of S{ = Xj <S> x 2 ® . . . x,-, 1 < i <n 

This problem is solved by organizing the computation in the form of a balanced binary 
tree. Prefix computation problem can be solved in <3(logrc) time with linear work O(n) 
on EREW PRAM [25]. 

Without doubt, prefix computation is the most frequently used subroutine in parallel 
algorithms. Consequently, there are a number of applications of it. We use the following 
variations of prefix computation in the later chapters. 

• Prefix sum: By considering the binary associative operator to be the usual sum- 
mation operator (+), we get the prefix sum. Note that, the sum of n elements 
is nothing but the value of s n . A problem related to prefix sums is compaction. 
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Out of the given n elements certain elements are marked. The problem is to 
bring together these marked elements, in the order they are existing in the original 
sequence, such that they occupy adjacent locations. This problem can be easily 
solved using prefix sums by assigning 0 to each unmarked element and 1 to each 
marked element and then applying prefix sum on it. At the end of it, each marked 
element will know its index in the set of marked elements. 

• Prefix Multiplication : By considering the binary associative operator to be the 
usual multiplication operator (*), we get the prefix multiplication. We use this 
operation to find values of factorials. 

• Finding OR: If we consider the binary associative operator to be boolean OR and 
the set S as the boolean values {0, 1}, then the OR of all the n boolean values is 
given by s n . 

Generalized Prefix Computation 

Generalized Prefix Computation [39] is defined as: 

Let f[m ] and y[m] be given sequences of elements for integers 1 < m < n. 

There is an arbitrary binary associative operator ‘(g)’ on the /-elements; the y- 
elements can be compared by a linear order The problem is to compute 
the sequence of general prefixes: 

E[m] = flfi] ® f[j 2 ] • • • ® f\jk] where ji < . . . < j k and {j u . . . ,/*} is the 
set of indices j <m for which y[j] '<’ y[m], where m is each index from 1 
to n. 

Generalized prefix computation can be done in O(logr?) time with n processors on CREW 
PRAM [39], 

List Ranking 

This is another frequently used subroutine in parallel algorithms comparable to prefix 
computation. Given a linear linked list having n nodes, the problem of list ranking is to 
find for each node, the number of nodes from that node to the end of the list. 

The basic technique used for solving list ranking is pointer jumping. This problem 
can be solved in O(logn) time with linear work on EREW PRAM[6]. 
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A problem related to list ranking is, we are given a set of linked lists with n nodes, 
and we want to find for each node, the identity of the last node in its list. This problem 
can be solved in the same bounds as given above for list ranking[25]. 

Cross Ranking 

Given A and B are arrays of length s and p respectively and their elements are in 
non-decreasing order, the problem of Cross-ranking (A, B) is defined as follows. It 
consists of computing two arrays X = Rank(A) and Y = Rank(B) (the elements of 
X and Y will be denoted x l5 x 2 , . . . x s and j/ 1 ,y 2 j • • • , J/ P . respectively) such that 

• X{ is the rank of a,- in B, defined as the number of elements in B that are less than 

ai. 


• yj is the rank of bj in A defined as the number of elements in A that are less than 
or equal to bj. 

Merging is a related problem in which given two sorted arrays we would like to obtain 
a sorted array containing all the elements in its input sorted arrays. The problem of cross 
ranking and merging are equivalent with respect to time and processor bounds[8]. 

Merging of two lists of combined length n containing integers in the range [l.'.n] can 
be done in 0(loglog*n) time with 0(n ) work on CREW PRAM[8]. The same problem 
can be solved in 0(a(n)) time with 0(n) work on COMMON CRCW PRAM[8]. 
Sorting 

Given a sequence of n elements {xi , x 2 , . . . , x n } from a set S on which a linear order 
is defined, the problem of sorting is to find a permutation w such that 1 < i < j < n if 
and only if x 7r (,-) < x r (j)- 

If comparison is the only allowed operation on the elements, then sorting of n elements 
can be done in O(logn) time with n processors on EREW PRAM[12], On the other hand, 
if the elements are from the domain of integers, we can do better. In particular, n integers 
drawn from a set {0, 1,2, . . . ,m — 1} can be sorted on an ARBITRARY CRCW PRAM 
[9] in time 0(logn/ loglog ra + log log m) with work of 0(n log log m) and in O(logn) 
time with 0(n log log n) work. 
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2.2 Standard Procedures 


In this section, we will look at some of the subroutines that are frequently used in later 
chapters. We will look at the problems and the algorithms for them in detail. 

The operation ranking occurs quite commonly in parallel algorithms for combinatorial 
generation. We present the ranking functions for permutations and combinations followed 
by their parallelization. 

2.2.1 Ranking of Permutation 

There exists a one to one correspondence between the integers 1, . . . , P{n, m ) and the 
set of m-permutations of {1,2..., n} listed in lexicographic order. 

Specifically, a function rankp with the following properties can be defined [3]: 

1. Let (P 1 P 2 ■ ■ -Pm) be one of the P(n,m) permutations of {1,2..., re). Then 
rankp(pi , p 2 • • • Pm) is an integer in {1, 2, . . . , P(n, m )}. 

2. Let {piP 2 -- -Pm) and (q 1 q 2 • • • <?m) be two m-permutations of {1,2..., n} then 

(p x p 2 ■■■Pm) precedes {q x q 2 ...q m ) lexicographically if and only if rankp{p u p 2 , ■ . ■ ,p m ) < 
rankp(q u q 2 ,...,q m ). 


For the permutation ( p x p 2 . . .p m ) define the sequence {r^ . . . ,r m } as follows: r t - = 
Pi - i + £j=l \pi < Pj] here [p; < pj] = 1 if pi < pf, and [p,- < pj] = 0 if pi > Pj. The 
string r\r 2 ...r m can be interpreted as a mixed radix integer where 
0 < r m < n — m 
0 < r m _! < n - m + 1 


0 < 7*2 < n — 2 

0 < r x < n - 1 

Expressing rjr 2 . .. r m as a decimal number gives us the integer corresponding to (p x p 2 . ..p m ): 

m — 1 m— t— 1 

rankp(p u p 2 , . . . ,p m ) = 1 + J2 r « II ( n ~ 1 “ o) 

»=i j=0 
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In the above equation there are m terms where the first term is 1 and the remaining 
terms are of the form r,- multiplied by a factor for each i from 1 to m — 1. We can easily 
see that in the above equation, the product njL"o ,-1 ( n — * — j) for each value of i can be 
computed as follows. We use m — 1 extra locations. Location i should contain the value 
n — i. Find the prefix products on this array in time O(logm) with O(j^j-) processors 
[19]. The value in the array location j corresponds to the multiplicand corresponding to 
r TO _j in the above equation. Next consider the computation of values of . . . r m for an 
arbitrary permutation ( p±p 2 . . . p m )■ To calculate r,-s the non-trivial term is < Pj] 

for each i, 1 < i < n, which in turn is a part of calculations of the number of inversions 
[27] of the given permutation. Calculations of the inversions can be done using the 
algorithm for Generalized Prefix Computation (see 2.1) which takes (9(logm) time with 
0(m) processors on the CREW model. Once these expressions are evaluated r,s can be 
calculated in constant time with 0(m ) processors. Then we can calculate the rank of 
the permutation (using above equation) in (9(logm) time with 0( j^j^) processors. We 
are using only simultaneous read capabilities. Hence the algorithm can be implemented 
on the CREW model. We summarize our discussion in the following theorem: 

Theorem 2.1 The rank of an r-permutation of n objects can be obtained in (9 (log r) time 
with r processors on CREW PRAM. 

Note that, if we use only EREW PRAM, the following theorem is not difficult to 
prove. 

Theorem 2.2 The rank of an r-permutation of n objects can be obtained in (9 (log r) time 
with 0(r 2 ) work on EREW PRAM. 

2.2.2 Ranking of Combination 

There exist a one-to-one correspondence between the integers 1,. . . ,C(n,r) and the set 
of r-combinations of {1, 2 . . . , n} listed in lexicographic order. Let (cjC 2 . .. c r ) represent 
one such combination (where by definition, ci < C 2 < .. .c r ). We define[3] 
complementing ci, C 2 , . . . , c r ) = ( d\d% . . . d T ) 

as the complement of (c^ . . . c r ) with respect to {1, 2 ... n}, where 
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d { = (n + 1) - c r _ i+1 

Now let the reverse of (cic 2 . . . Cr) be given by (crC r -i . . . c{). The mapping 
order (ci, c 2 , . . . <v) = £•_ i C(a - 1, i) 
has the following properties: 

1. if (c 1 c 2 ...c r ) and (qq . . . c' r ) are two r-combinations of {l,2,...,n} and the 
reverse of (cic 2 . . .Cr) precedes the reverse of (qq • • • c{) in lexicographic order, 
then 

order(ci,c 2 ,.. .Cr) < order{c x ,c 2 , . . . ,c{); 

2. order( 1,2, . . . ,r) = 0 and order((n — r + 1), (n — r 2), . . . , n) = C(n,r) — 1 
implying that the transformation order maps the C(n, r) different r-combinations 
onto {0, 1, . . . C(n,r) — 1} while preserving reverse lexicographic order. 

Using order and complement, we can define the following one-to-one mapping of 
C(n,r) possible combinations onto {1,2, C(n,r)}, which preserves lexicographic 
ordering: 

rankc(n,ci,c 2 , . . . , q) = C(n,r) — order(complement(n,c 1 ,C 2 , . . . , q)). 

Thus rankc(n , 1, 2, . . . ,r) = l,rankc(n, 1,2, . . . ,r + l) = 2, . . . , rankc(n , (n — r + 
!)>(** -r + 2),..., n) = C(n,r). 

It is easy to note that based on the ranking function, we can find the rank of an 
r-combination in O(logr) time using r/logr processors as we have to sum r values. 

2.3 Generic Processor Allocation Problem 

In this section, we describe the processor allocation problem which we will be encountering 
in our algorithms. The problem is formally stated as follows: 

Processor Allocation Problem: We have to accomplish s identical tasks but on data 
sets of different lengths. The number of processors needed by task i are given by size[i ] 
and they are indexed by start[i] to end[i]. Given this information, we would like to form 
two arrays G and N , where G?[t] specifies task number for which processor i should work 
and A r [i] specifies the index of the processor i out of all the processors that are allocated 
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to its task viz. Gr[z]. Further, start[i] = end[i — 1] -f 1 for 1 < i < s, i.e the tasks use 
the adjacent set of processors. 

Once the information G and N are known, it is easy to allocate the processors[9]. 
We can also observe that if out of the three arrays start, end and size, any two are 
known, we can obtain the third one: 

size[i) = end[i ] — start[i] + 1 

Let p — size[i], i.e, p is the total number of processors needed for all the tasks. 
We assume p is available as part of the input to the algorithm. 

We proceed as follows. We form an array B such that B[i] = i, 1 < i < p. The 
cross ranking of start and B provides us with the necessary details. Note that start and 
B are non-decreasing arrays of length s and p respectively and they contain integers in 
the range [l..p]. The problem of cross-ranking(A, B) is defined as follows. It consists 
of computing two arrays X = Rank(A) and Y = Rank(B) (the elements of X and Y 
will be denoted xi,x^, . . .x s and y x , y 2 , . . . , y p , respectively) such that 

• Xi is the rank of a,- in B, defined as the number of elements in B that are less than 

CL{. 

• yj is the rank of bj in A defined as the number of elements in A that are less than 
or equal to bj. 

The problem of cross ranking and merging are equivalent[8]. 

Since G[i] represents the task to which processor i should be allocated, is equal 
to the number of elements in A which are less than or equal to i. As i > A[y,-] and 
i < A[y i+ i], it follows that, processor i should be allocated for task y,- as it is in the 
range of [start[yi\..end[yi]]. It is obvious that N[i] = i — start[G[i]} + 1, 1 < i < p; 

Merging of two lists of combined length n containing integers in the range [L.n] can 
be done in 0(loglog*n) time with 0(n ) work on CREW PRAIVI[8]. The same problem 
can be solved in O(o;(n)) time with 0(n ) work on COMMON CRCW PRAM[8]. 

Note that the only operation that takes non-constant time in the above algorithm is 
cross ranking. 

Thus, we obtain the following theorems. 
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Theorem 2.3 The Generic processor allocation problem can be solved with a time com- 
plexity of 0(log log *(s + p)) and 0(s + p) work on the CREW PRAM. I 

Theorem 2.4 The Generic processor allocation problem can be solved with a time com- 
plexity of 0(a(s +p)) and 0(s+p ) work on the COMMON CRCW PRAM. I 
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Chapter 3 

Faster Optimal Parallel Algorithms 
for the Generation of Permutations 

3.1 Introduction 

The problem of generating permutations has a long history, and a large number of se- 
quential algorithms exist for its solution. This history is traced in [38] along with a 
review of the different approaches. Parallel permutation algorithms have been designed 
for SIMD computers with no communication between processors[22] and for linear pro- 
cessor arrays[5, 11]. A cost optimal algorithm employing up to P(n,r)/n processors is 
presented in [2]. Another cost optimal algorithm with 0(n ) time complexity is presented 
in [34]. In this chapter, we discuss new parallel algorithms for enumerating permutations. 

We begin with some definitions. Let S' be a set consisting of n distinct items say, the 
first n positive integers, i.e, S = {l, 2 ,...,n}. An r -permutation of S is obtained by 
selecting r distinct integers out of S and arrange them in some order. Thus, for example, 
for n = 10 and r = 4, a 4-permutation might be (5 7 9 3). Two r-permutations are 
different (or distinct) if they differ either with respect to the items they contain or with 
respect to the order of items. The number of distinct r-permutations of n items is 
denoted by P(n,r), where P(n,r) = ^ 3 ^. Thus, for n = 4, there are twenty four 
distinct 3-permutations. In the special case, where r = n, P(n,n) = nl. 

Now, let x = (x\X 2 . • • x r ) and y = (yxy 2 . . . y r ) be two r-permutations of S. We 
say that x precedes y in lexicographic order if either Xi < j/i or if there exists an integer 
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i, 1 < i < r, such that Xj = y, for all j < i and x t - < y { . 

Each r-permutation has an associated index in lexicographic order. By ranking we 
mean getting the index of an arbitrary permutation in lexicographic order. Similarly, 
unranking means getting the r-permutation given its index in the lexicographic order. 
Thus, unranking is the inverse operation of ranking. 

Note that lexicographic order is a total order [42](i.e, if A and B are two permuta- 
tions, then either A -< B or A — B or A >- B\ we use the notation to represent the 
relation lexicographic precedence). 

In Sections 2 and 3 we describe two algorithms which are much faster when compared 
to the existing algorithms. Both algorithms are designed based on induction and recursion 
and are inspired by [32] in which induction and recursion are used as a design technique 
to derive new and efficient algorithms. 

For generation of r-permutations of n objects there are two parameters viz. r and n. 
The recursion can be applied on either of these parameters. The algorithm in section 3 
correspond to recursion on the parameter r (r-recursive algorithm) while that of Section 
4 correspond to the parameter n (n-recursive algorithm). 

3.1.1 Preliminaries 

In this section, we discuss few basic concepts related to permutations for later easy 
reference. The reader is referred to [26] for proofs. 


_ f v nl 

P (n,r) = 

(n — r)! 

(3.1) 

P(n, r) = n(n — 1) . . . (n — r + 1) 

(3.2) 

P(n,r ) = 0, if n < r. 

(3.3) 

P(n u r) < P(n 2 ,r), if m < n 2 

(3.4) 

P(n, ri) < P(n , r 2 ), if 0 < r x < r 2 < n 

(3.5) 
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We assume that 


/ 


P(n,r ) = 0, if r < 0 or n < 0 


(3.6) 


C(n,r) 


n! 

(n — r)!r! 


(3.7) 


3.2 The r-Recursive Algorithm 

3.2.1 Basic Algorithm 

Suppose we are interested in generating all the r-permutations of n objects in lexico- 
graphic order. The main idea behind the algorithm is we generate r-permutations if 
—permutations of n objects are available to us; thus, the algorithm is recursive. The 
termination of recursion is when r = 1 in which case obtaining the 1-permutations of 
n objects is trivial; the 1-permutations of n objects are the n objects in order. The 
algorithm is given below. 


Pre-Processing 

// Calculate P(s,t ) for 1 < s < n and. 1 < t < r. 

Store these values in a two dimensional array perm. 

1 for i = 1 to n*r in parallel do 

// group and shift are local variables of each processor 
/* form n arrays of length r each, filled by consecutive 
integers with starting value as i, 1 <i <rt */ 
group = (i-1) div r + 1; 
shift = (i-1) mod r + 1; 

val[ (group -1) * r + shift] = group + shift - 1; 

2 Calculate prefix multiplications of n segments of array val 
independently and simultaneously, where each segment is of 
length r and the i-th segment starts at (i-l)*r + 1 

3 for s = 1 to n in parallel do 

for t = 1 to r in parallel do 
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if t > s then perm.[s,t] = 0 
else perm[s,t] * val[(s-t)*r + t] ; 


Algorithm Generat e_Permutat ions (n , r ) 

Begin 

4a) if r = 1 then 

for i = 1 to n in parallel do 
A[i,l] = i; 

4b) else 

Generate_Permutations(n,|) ; 

Double_Size() ; 

End 

DoubleJBizeO 

Begin 

5 Copy the -“permutations from array A to a separate array B; 

// obtain the £ -permutations of the n — - objects {1, 2, . . . , n — -} 

6 Mark those ^-permutations in array B which have an 

item greater than n — |; 

7 Rank all the unmarked —permutations of array B storing them in array C 

8 For each ^-permutation of array A obtain the sorted list of its items; 

9 For each | -permutation obtain the sorted list of unused elements; 

10 Form r-permutations by matching ; 

End 

The algorithm as given works under the following assumption. 

Assumption: r must be a power of 2. 

We relax this restriction in Section 3.2.2. 

We will initially describe the pre-processing steps. In the pre-processing we find the 
values of P(s,t) when 1 < s < n and 1 < t < r. To complete pre-processing in 
O(logr) time, we find the prefix multiplication of range of length r for each starting 
value from 1 to n. This has been accomplished by an application of standard prefix 
multiplication algorithm [19] on these different sets independently and simultaneously. 
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Once these values are found it is easy to find the values of P(s,t ) for the given ranges 
of s and t as already specified using Eq. (3.2). This can be done in constant time. 

The main algorithm is recursive in nature. The base case of the recursion is when 
r = 1 is easy; the 1-permutations of n objects are simply the n objects in lexicographic 
order. DoubleSizeQ when given all —permutations obtains all r-permutations. 

First consider the following example. Consider the 2-permutations of 4 objects 
{1,2, 3, 4} in lexicographic order (top to bottom, left to right): 

(1 2) (2 3) (3 4) 

(13) (2 4) (4 1) 

(14) (3 1) (4 2) 

(2 1) (3 2) (4 3) 

Consider the 4-permutations of 4 objects {1,2, 3,4} shown below. 

(1 2 3 4) (2 3 1 4) (3 4 1 2) 

(1 2 4 3) (2 3 4 1) (3 4 2 1) 

(1 3 2 4) (2 4 1 3) (4 1 2 3) 

(1 3 4 2) (2 4 3 1) (4 1 3 2) 

(1 4 2 3) (3 1 2 4) (4 2 1 3) 

(1 4 3 2) (3 1 4 2) (4 2 3 1) 

(2 1 3 4) (3 2 1 4) (4 3 1 2) 

(2 1 4 3) (3 2 4 1) (4 3 2 1) 

Let us consider r-permutations of n objects in lexicographic order. Considering their 
prefixes of length | in order, we observe that: 

Lemma 3.1 For r-permutations in lexicographic order the prefixes of length i (when 
i < r) and adjacent duplicates are removed, are in lexicographic order and they are the 
i-permutations of n objects {1, 2 , . . . , n}. 

Proof: Lemma can be easily proven by contradiction. I 

From Lemma 3.1, for each —permutation there will be a set of r-permutations with 
this ^-permutation as prefix. Further, all these r-permutations will be together. 

Consider the prefixes of length i of an r-permutation of n objects. Let it be 
d,c 2 ,. . . ,c,-. The prefix is an i-permutation of n objects. Thus, every prefix of length i 
of any r-permutation is an i-permutation of n objects. 
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In the above example, with 1 2 as a prefix there are two 4-permutations. In fact, with 
a given prefix of length i, there will be P(n — i,r — i ) r-permutations. We consider the 
|-permutations as prefixes of the potential r-permutations, and use them to obtain all 
r-permutations, i.e we find the suffixes that should be added to each ^-permutation to 
make them r-permutations. 

Theorem 3.2 Given p-permutations of n objects in lexicographic order and given any 
arbitrary q-permutation Q = (c x c 2 . . . c q ) of n objects. There will be P(n - q.p - q) 
p-permutations with this q-permutation as prefix. The suffixes that are appended to Q 
to form the p-permutations are the ( p — q)-permutations of n-q objects {l,2,...,n}- 
{ci , c 2 , . . . , c q }. More over these p-permutations are lexicographically consecutive in the 
given p-permutations, i.e, they are ordered such that the suffixes of length p — q are 
ordered lexicographically. 

Proof: In the theorem, by lexicographically consecutive, we mean those p-permutations 
which have consecutive ranks in lexicographic order; the p-permutations with the same 
prefix are together in lexicographic order. 

We first prove the existence of P(n — q,p — q ) p-permutations with the given prefix. 
Then, we prove that they are adjacent lexicographically, 

Let us consider the given 9-perm utation of n objects Q = (cjc 2 . . . c 9 ). Let s = 
p — q. Let us also consider the s-permutations of the n — q objects B = {1, 2, . . . , n} — 
{c x , c 2 , . . . , c 9 }. Let a = (aia 2 . . . a s ) be an arbitrary s-permutation of B. Append the 
s-permutation a to Q to form D. D is a p-permutation of n objects as all the items in 
D are distinct and are coming from the set of n objects {1,2,. .. ,ra} and is of length 
p. Since, we have started with an arbitrary s-permutation, it follows that each of the 
s-permutations of n — q objects can be appended to Q getting a p-permutation of n 
objects. Further, all such formed p-permutations are distinct. 

Now, we prove that whenever a p-permutation is there with Q as prefix, its suffix of 
length s is a s-permutation of B. Suppose u = (uiu 2 ...u p ) is a p-permutation with Q 
as prefix. Obviously, u,- = c t - for 1 < i < q. Let us consider the part (u 9+1 , . . . , u p ) i.e 
the suffix of length s = p — q of the above p-permutation. The elements of the suffix 
must be coming from the set B as in a permutation all the elements must be distinct. 
From this it follows that the above suffix is a s-permutation of B. 
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Since there are P(n — q,p — q). 5-permutations of B, there will be P(n — q,p — q) 
p-permutations with the prefix as Q. 

From our above claims, we noted that the p-permutations, with the given prefix have 
the suffixes which are nothing but the s-permutations of n— q objects B, Now, it remains 
for us to prove that all these p-permutations with our prefix will be lexicographically 
adjacent if we consider the total p-permutations of n objects. 

We prove this in two steps. We first prove that all our p-permutations will be together 
in the complete p-permutations in lexicographic order. Later we prove that they are 
adjacent lexicographically (consecutive ranks). We prove this by contradiction. Suppose 
they are not together. Then this means that there exists three p-permutations B\, B 2 and 
B 3 such that B\, B 3 have the prefix t\ = (cic 2 . . . c q ) and B 2 has a different prefix t 2 of 
length q and Bi,B 2 and B 3 are in lexicographic order (not necessarily adjacent). Since 
ti and t 2 are different and B\ precedes B 2 lexicographically it follows that t x precedes 
t 2 lexicographically. But this implies B 3 precedes B 2 lexicographically. A contradiction. 
Hence all the p-permutations with the same prefix are together. 

Once we have proved that the p-permutations with the prefix as our original q- 
permutation are together it is easy to prove by contradiction that they are adjacent 
lexicographically such that the suffixes of length p — q are in lexicographic order. 

Note that our complete p-permutations are in lexicographic order. In that p-permutations 
with prefix as Q are together and are in lexicographic order. We have to prove that the 
suffixes of our p-permutations with the given prefix are ordered lexicographically. Sup- 
pose they are not. Then there exist two p-permutations to and a; such that both have 
the same prefix (ci, c 2 , . . . , c ? ) and have suffixes such that they are not in lexicographic 
order while w and x are in order lexicographically. Since both have the same prefix if 
the suffixes are not in lexicographic order then by definition, w and x can not be in 
lexicographic order. Hence a contradiction. 

Putting all this together our claims follow. I 

As a corollary to the above theorem, we have 

Corollary 3.3 Let ( a\a 2 . . . a j) be permutation ofn objects. The suffixes that should 
be added to this £- permutation to make the corresponding r-permutations are the |- 
permutations ofn — \ objects {1, 2, . . . , n} — {a l5 a 2 , . . . , at}. I 
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So, once we know the suffixes that should be added to each —permutation then it is 
easy to obtain the r-permutations of n objects. We next address the question of getting 
the above ^-permutations of n-\ objects {1, 2, . . . , n} - {o x , a 2 , . . . , az}. Note that 
for each ^-permutation P, the suffixes are coming from the ^-permutations of a set of 
n — | objects which is a subset of {1,2,..., n } depending on P. We have with us the 
^-permutations of n objects {1,2, . . . , n}. The following lemma is required. 

Lemma 3.4 If we have the p-permutations of u objects {1,2,..., u} in lexicographic 
order, then the p-permutations of any other set {e x , e 2 , . .. ,e u } can be obtained as 
follows: 

1. Sort the elements of the set {e x , e 2 , . . . , e u } to get the set {p l5 p 2 , • ■ • ,p u }. 

2. Map the element gi to i, and in p-permutations of u objects {1,2,..., u} replace 
i with gi. 

Then the resulting permutations are the p-permutations of u objects {e x , e 2 , . . . , e u } 
in lexicographic order. 

Proof: The proof is based on the fact that i < j (here i and j are elements of the set 
{1, 2, . . . , u}) if and only if g { < gj. 

If a is a p-permutation of {1,2,..., u} then we obtain a permutation a' by replacing 
i with gi in the above _p-permutation. The p-permutation we have got is a p-permutation 
of {el, e2, . . . , eu}.We denote by m! the corresponding permutation of {el, e2, . . . , eu} 
where m is the permutation of {1,2,..., u}. 

From this fact and definition of lexicographic order (see Section 3.1), we can easily 
prove that if a p-permutation w precedes another x of {1,2,.. .,u} then their corres- 
ponding permutation w 1 precedes x' in lexicographic order. I 

Thus, if we have with us the ^-permutations of the set of n — | objects {1, 2, . . . , n — 
|} then we can get easily obtain the ^-permutations of any other set with the same 
cardinality. So, we next look at the problem of getting ^-permutations of the set of n — | 
objects {1,2, . . . , n — |}. 
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Note that we have with us the —permutations of n objects {1,2, ...,n}. We can 
see that every f-permutation of n-\ objects { 1 , 2 , . . . ,n - §} must be there in \- 
permutations of n objects. More over, it will be occurring only once as part of -- 
permutations. But they will be scattered throughout the ^--permutations of n objects. 
So, we have to bring together these ^-permutations of { 1 , 2 , . . . , n — 5 }. This we will 
do as follows. 

We consider the elements n — | + 1 , . . . , n as dummy elements in the above — 
permutations. So for each —permutation, we will mark it if it contains at least one 
dummy element. This can be done by assigning P(n,|).£ processors such that each 
item gets one processor and that processor decides whether its item is dummy or not. 
Later using logical OR all the processors for an ^-permutation can decide whether that 
^-permutation should be marked or not. 

Once we marked the unwanted ^-permutations, we have to rank all the unmarked 
^-permutations to form the |-permutations of n — \ objects {l,2,...,n — |}. It is 
important to realize that even though we should rank only the unmarked ^-permutations, 
processors are assigned to marked —permutations nevertheless; these processors remain 
idle. This is done to avoid the processor allocation complication that may arise if we want 
to assign processors only to the unmarked permutations. Now we look at the problem of 
getting rank of a permutation to locate its index in lexicographic order. 

We can calculate the rank of the permutation in 0(log m) time with pro- 

cessors (see Section 2.2.1) on CREW PRAM.. 

Using this ranking procedure, we rank all the unmarked ^-permutations. Then, we 
store the unmarked ^-permutations in an array C at the position indicated by their rank. 
So, array C contains the ^-permutations of n — 5 objects { 1 , 2 ,. . . ,n— £} in lexicographic 
order. 

After obtaining the ^-permutations of n — | objects { 1 , 2 , . . . ,n — |} we use Corol- 
lary 3.3 and Lemma 3.4 in conjunction for the generation of r-permutations of n objects; 
basically, for each ^-permutation we would like to attach the corresponding suffixes as 
defined by Corollary 3.3 to obtain the r-permutations. 

Consider an arbitrary j-permutation P = ( a 1 a 2 ■ . . a:) of n objects {1,2, . . . ,n}. We 
call the set {< 21 , a?, , a:} the set of used elements. Similarly, M p = {1,2, . . . ,n} — 
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{ a i-, a 2 ,. . . ,a^} is called the set of unused elements. We would like to determine for 
each |-permutation its sorted list of unused elements. 

We discuss the finding of this for an arbitrary "permutation. The procedure can 
then be applied independently and simultaneously to each "permutation. 

Let (ai<22 . . . ar) be an arbitrary —permutation. We sort these elements using Cole 
sort [12] to get the sorted list of elements say, B = (61,62) • • • )6i). Let B p be an array 
of length n initialized with zeroes. We mark B p [a t -] for all i in this array. This can be 
done in constant time using | processors. Thus, the unused elements are the unmarked 
elements in the array B p . Let A p be another array of length n with A p \i] - i, for all 
1 < z < n. From Cross — Rank(B,A p ) (see Section 2.1), we get an array Y such 
that yi is the number of elements in B which are less than or equal to A p [i] = i. For 
each unused element we intend to find its position in the sorted list. Now, consider an 
arbitrary i. If B p [i] = 1, then we can ignore i as it is an used element. On the other 
hand, if B p [i] = 0, then proceed as follows. Note that i does not belong to B. There 
are y,- used elements that are less than i; there are i — yi unused elements that are less 
than or equal to i. Hence, the index of i in the list of unused elements is i — yi. Let 

C P [i - yi] = i. 

We use Lemma 3.4 to form the r-permutations. This is done in two steps. 

In the first step we assign P(n — |, 0 .| processors to each —permutation and for 
all i, 1 < i < P(rz, |), copy the i th —permutation P(n — |, |) times and place these 
in locations (i - 1 )P(n — §>§) + ! to iP( n ~ §) of the array E. Here E is a two 

dimensional array of length r in its second dimension. The permutations occupy locations 
1 to | in its second dimension. 

In the second step, we again assign P(n — processors to each —permutation. 

Each processor copies the ^-permutations of n — | objects {1, 2 , . . . , n — |} with proper 
matching. By proper matching we mean suppose a processor is copying an element i then 
it will put C p [i ] corresponding to it where this processor is devoted to p th ^-permutation. 
More over these P(n - §, processors copy into locations (i- 1 )P(n - 5) + 1 to 

iP(n — |) of array E except that the locations are | + 1 to r in the second dimension 

of it. Once this processing is finished, E[i] is the i th r-permutation of the n objects 
{1,2, . . . ,n} in lexicographic order for all i, 1 < i < P(n,r). 
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We next analyze the algorithm- First, consider the pre-processing part of the al- 
gorithm. In the first step we are initializing tables which needs constant time and nr 
processors. In the next step we are finding the prefix multiplications of a number of 
segments of equal length simultaneously and independently. We are using the standard 
algorithm for prefix multiplication [25]. It takes O(logr) time as each segment is of 
length r. The total work done is 0(nr ) as the prefix multiplication algorithm is optimal. 
Then, we find the values of P(s,t ) where 1 < s < n and 1 < t < r. This is calculated 
using Eq. ( 3 . 2 ) and can be done in constant time with nr processors by a table look-up. 

Thus, the total time for the pre-processing is O(logr) with 0(nr) work. 

Let T(n,r) and W(n,r ) denote the time complexity and the work done by the al- 
gorithm respectively when we are generating r-permutations of n objects. 

The algorithm is recursive and the base case of the recursion occurs when we need 
to generate the 1 -permutations of n objects. This we can do in constant time with n 
processors (see Step 4a). If not, we recursively call the algorithm on n and |. Obviously 
this takes a time of T(n, |) and a work of W{n, |). 

Double-Size obtains r-permutations from —permutations. We assume that the |- 
permutations are available in an array. In Step 5 we are copying the ^-permutations to 
a different array B. This can be done in constant time with P(n, processors. We 
are marking those |-permuta.tions which contain a value greater than n — | in Step 6 . 
This takes a time of O(logr) and work of 0(P(n, %).%), as marking involves finding 
the OR of | items for each ^-permutation. In Step 7 we are ranking all the unmarked 
^-permutations using the procedure described in Section 3.2.1. We are assigning | 
processors to each ^-permutation (not necessarily unmarked permutations) but only that 
those assigned to unmarked —permutations will be finding the rank and others will be 
idle. Thus, ranking and the consequent storing of all these unmarked permutations in 
order into array C takes a time of 0(log 5 ) with P(n,|).£ processors. 

In Step 8 , we are sorting each ^-permutation independently and simultaneously using 
Cole’s merge sort [12]. This takes 0(log §) time and 0{P(n, |)£ log §) work. In Step 9, 
we use merge to get the sorted list of unused elements of each ^-permutation. Thus, this 
can be implemented in 0(loglog*n) time with 0(P(n , j).n) work on CREW PRAM[ 8 ]. 

We are obtaining the final r-permutations of n objects in lexicographic order, by 
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assigning P(n — |).r processors to each —permutation in constant time. In other words 
Step 10 can be implemented in constant time with P(n, %).P(n — §,|).r = P(n, r).r 
processors. 

From the above discussion, we form the following recurrence relations. 


T(n,r) = 


T(n , |) + Ci log r + c 2 . log log* n + c 3 when r > 1 
C 4 when r = 1 


where C\, c 2 , c 3 and c 4 are constants. 

There are logr levels of recursion. As shown above each level takes 0(logr + 
log log* n) time. Thus [13], 

T(n, r ) = 0(log r(log r + log log *n)) 

Similarly for the work performed by the algorithm, the following recurrence relation 
holds: 

„„ , / W(n/^ + k 1 P(n^Y 1 + k 3 P(n,^log r 1 + +k 5 P(n,l)n + k 6 P(n,r)r 

W(n,r) = < 

I k 7 n 


where ky, k 3l k 5 , k 6 and k 7 are constants. 

As r < n, | < |. 

Let us consider 

P(n, r )/P(n, §) = = (»-§)(»- 5 - 1) r + 1) 

There are | terms in this expression, and | > 1. 

Since n — |>f, 


P(rc,r) > » 

P(n,§) - 2 

when r > 1 and r is a power of 2 . 

Note that log \ < f • 

So using Eq. ( 3 . 8 ) and Eq. (3.5) we obtain 


(3.8) 


W(n,r)<W(n,^) + k.P(n,r).r (3.9) 

when r > 1 . 

where & is a constant. 


when r > 1 
when r = 1 
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We formally show that W(n,r) < 2 k.P(n,r).r 
Proof: The proof is based on induction on r. 

As base case consider when r = 1. From the algorithm, we know that W(n, 1) = 
k 7 .n < 2 k.n — 2 k.P(n, l).l when 2k > k 7 . 

For the induction hypothesis, let us assume that W(n,r ) < 2 k.P(n,r).r. 

Let us consider the case 2 r < n. 

So, W(n,2r) < W(n,r ) + k.P(n,2r)2r < 2k.P(n,r).r + k.P(n,2r).2r, 
using induction hypothesis and Eq. 3.9. 

So, W{n , 2 r) < k.P{n , r).2r + k.P(n, 2r).2r < k.P(n , 2r).2r + fc.P(n, 2r).2r 
using Eq. (3.5) 

= 2k.P(n,2r).2r 

Hence our claim. I 

Generation of r-permutation of n objects has a lower bound of 0(P(n,r).r). This 
is the size of output. So, our algorithm is work optimal. Thus, we obtain the following 
lemma. 

Lemma 3.5 Algorithm works with a time complexity of 0 (log r (log r+ log log *n)) with 
optimal work 0(P(n,r)r ) on CREW PRAM given r is a power of 2. 

Note that we can merge two arrays of combined length n can be done in a(n) time 
when the elements are integers in the range l..n (see Section 2.1). Thus we get the 
following lemma: 

Lemma 3.6 Algorithm works with a time, complexity of O(logr(log r -f a(n))) with 
optimal work 0(P(n, r)r) on CREW PRAM given r is a power of 2. 

3.2.2 Generalization of the Algorithm 

In the above section, we have seen that the r-permutations will be generated only when 
r is a power of 2. In this section, we generalize that algorithm for the case where r is 
not a power of 2. 

This generalized algorithm is very similar to the original restricted algorithm. In 
fact, it uses the original algorithm in itself. More over the approach that is used in the 
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generalized algorithm in its basic form is same as that of the restricted algorithm. The 
algorithm is given below. 

ill Calculate all the values of P(s,t) where for 1 <s<n and 1 <r. 

Algorithm Generate_Permutations_General(n,r) 

Begin 

2 Ti is the maximum integer such that 

a) t i is a power of 2 

b) r x <= r 

c) Let r 2 = r — r 1 

3 Generate-PermutationsCnjr!) ; 

4 Increase_Size(a, r x , r 2 ) ; 

End 

Increase_Size(a, r x , r 2 ) 

Begin 

5 Obtain the r 2 -permutations of {a + 1, a + 2, ..., n}; // r x = a + r 2 

6 Obtain the r 2 -permutations of {1, 2, ..., n — a}; 

7 Obtain the r 2 -permutations of {1, 2 , ..., n — r x } by ranking; 

8 For each r x -permutation obtain the sorted list of unused elements; 

9 Copy the needed values by matching; 

End 

We are interested in generating r-permutations of n objects, when r is not a power 
of 2. We reduce this problem to our earlier one, where r is a power of 2. We find r x 
such that it is the largest integer which is a power of 2 and is less than or equal to r. So 
r x is the value of most significant bit(MSB) in the binary representation of r. We find 
r 2 such that r x + r 2 = r. 

Observe that 
Observations 2 : 

1. r x > r 2 

2- r, > m 
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3- >-2 < LiJ 

Once we have obtained ri, we generate the ri-permutations of n objects using our 
earlier algorithm as r x is a power of 2. These rx-permutations are stored in a two dimen- 
sional array, A. We obtain the r-permutations of n objects using these r x -permutations 
We use the procedure Increase-Size to obtain r-permutations. 

Observe that each ^-permutation acts as a prefix for P(n-r 1 ,r-r 1 ) = P(n—ri,r 2 ) 
r-permutations (see Theorem 3.2). Suffixes that should be attached to any given r x - 
permutation (a x a 2 . . . a ri ) are the r 2 -permutations of n — r x objects S" = {1,2, . . . ,n} — 
{ai,a 2 , . . . , a ri }. Hence, if we obtain r 2 -permutations of S', we attach them to get the 
r-permutations of n objects for a given ri-permutation; So, if we are able to obtain the 
r 2 -permutations of some set of cardinality n — r x then we can obtain the r 2 -per mutations 
of any other set with the same cardinality using Lemma 3.4. Note that if we attach these 
suffixes to the ^-permutations in order we will get the r-permutations of n objects in 
lexicographic order based on Lemma 3.1 and Theorem 3.2. 

We next obtain the r 2 -permutations of the set {1,2, ...,n - r x }. We would like 
to get the r 2 -permutations of the set {1,2, ... , n — r x } from the ^-permutations of n 
objects {1,2,..., n} in lexicographic order (which we already have). Let us consider the 
prefixes of length a = r x — r 2 of ^-permutations; a > 0 as r x > r 2 . These prefixes are 
a-permutations of n objects {1,2,..., n}. The first a-permutation in lexicographic order 
for this set of objects is (12 ... a). From Lemma 3.1, we know that the ^-permutations 
with this a-permutation will be coming first. Also, from Theorem 3.2, we know that 
the suffixes added to this a-permutation to form ^-permutations are (r x — a = r 2 )- 
permutations of n — a objects {1, 2, . . . , n} — {1, 2, . . . , a] = {a + 1, a + 2, . . . , n}. So, 
if we take the suffixes of length r 2 of the first Pin — a,r 2 ) ^-permutations then we have 
obtained the r 2 -permutations of n — a objects {a + 1, a + 2, . . . , n}. Using Lemma 3.4, 
we obtain from these the r 2 -permutations of n — a objects {1,2, ...,n — a}. Recall 
that a < 7 ~i as r 2 > 0 (since r is not a power of 2.). Hence n — a > n — r x . So, we 
consider the elements n — r x + 1, • • • , n — a as dummy elements and then we rank the 
r 2 -permutations which do not contain any dummy element to obtain the r 2 -permutations 
of n — rj objects {1,2, . ..,n — r x }. 

Once we have obtained the r 2 -permutations of n — r\ objects {1, 2, . . . , n — rj), we 
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need to get the sorted list of unused elements of each ^-permutation so that we can 
attach the suffixes to them to obtain the r-permutations using Lemma 3.4. So, now we 
want to obtain the sorted list of unused elements for each ri-permutation. 

We proceed in two different ways depending upon the value of r with respect to y. 

Case r < | 

In this case, the way we proceed is similar to the way we have done in 
our earlier algorithm. For a given ri-permutation, we first sort its elements 
and then use cross ranking to get the sorted list of unused elements, (see 
Section 3.2.1) 

Case r > j 

Let us consider an arbitrary ^-permutation (aia 2 . . . a ri ). We use another 
array I of length n initialized with ones. Then all the rx elements of the 
above ri-permutation write 0 into their location; i.e, i-th element writes 0 
in the location /[a,]. Then apply prefix sums on array I. Suppose j is an 
unused element then I[j] contains the index of j among the unused elements 
in sorted order. So, write j into the location I\j] of another array meant for 
storing these sorted list of unused elements; i.e (?[/[?]] = j. 

If we use the above routine depending on the case for each ri-permutation, we will 
obtain the sorted list of unused elements. Once we have got this, we can use Lemma 3.4, 
to get the r-permutations of n objects. 

We will do this in two steps. In the first step for all i, 1 < i < P(n,>x), we 
assign P(n — rx,r 2 ).ri processors to i th ri-permutation and copy that ri-permutation 
into locations (i - l)P(n-rx,r 2 ) + 1 to iP{n-r x ,r 2 ) of the array E. Here E is a two 
dimensional array of length r in its second dimension. Thus, the permutations occupy 
the locations 1 to rx in its second dimension. 

In the second step, we assign P(n — rx,r 2 ).r 2 processors to each ri-permutation 
such that they copy the r 2 -permutations of n — rx objects {1,2, . . . ,n — n} with proper 
matching. By proper matching we mean suppose a processor is copying an element j then 
it will put Ci{j] corresponding to it where this processor is devoted to i th n-permutation. 
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More over these P(n — r 1? rs)r 2 processors copy into locations (i — l)P(n — 7^! , r 2 ) H- 1 to 
iP(n — r x , r 2 ) of array E except that the locations are r x + 1 to r in the second dimension 
of the array E. Once this processing is finished the array E contains the r-permutations 
of the n objects {l,2,...,n} in lexicographic order. In other words, P[i] contains the 
z-th r-permutation in lexicographic order. 

We analyze the algorithm. Let T(n,r ) and W(n, r) denote the time complexity and 
the work of the generalized algorithm respectively when we are generating r-permutations 
of n objects. 

In Step 1, we are calculating the values of P(s,t ) where 1 < s < n and 1 < t < r. 
This will be calculated as in restricted algorithm. Hence it takes O(logr) time with 
0(nr ) work. 

In Step 2, we are finding the value of r x . It can be obtained in constant time with 
a single processor. In Step 3, we are making a call to our restricted algorithm with 
parameters n and r x . Hence, we obtain the r x -permutations of n objects in a time of 
OQogr^logrx + loglog*n)) and a work of 0(P(n, ri).r x ). In Step 4, we are calling 
Increase-Size to obtain the r-permutations from these ^-permutations. 

We are obtaining the r 2 -permutations of {a + 1, a + 2, . . . , n} in constant time 
with P[n — a,r 2 ).r 2 processors (Step 5). In Step 6, we obtain the r 2 -permutations of 
{1,2, ... ,n — a} in constant time with the same number of processors. In Step 7, we 
rank, the r 2 -permutations to obtain the r 2 -permutations of {1,2,. .. ,n — r x }. To rank 
an r 2 -permutation, we take a time of O(logr 2 ) (see Section 3.2.1) with r 2 processors. 
In other words, ranking takes a time of 0(logr 2 ) with 0(P(n — a,r 2 ).r 2 logr 2 ) work. 

In Step 8, we are finding the sorted list of unused elements for each rx-permutatipn. 
Depending upon the value of r with respect to j we proceed in two different ways. 

If r < |, then we initially sort each ^-permutation, which takes a time of O(logri) 
with 0(P(n, rijn logr x ) work. Later, we use cross ranking to obtain the sorted list of 
unused elements which take a time of O(loglog*n) with 0(P(n, ri).n) work. 

On the other hand, if r > |, then we use prefix sums to obtain the sorted list of 
unused elements which take a time of O(logn) with 0(P(n,ri).n ) work. 

In any case, in Step 9, we copy the r 2 -permutations to obtain the r-permutations of 
n objects. This can be done in constant time with P(n,r).r processors. 
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We consider further analysis as based on the value of r with respect to 
Case r < | 

T(n,r) = 0(logrx(logri + log log *n)) + Ci.logr 2 + c 2 + c 3 .logrx + c 4 .loglog*n 
where c 1 ,c 2 ,c 3 and c 4 are constants. 

As r x < r and r 2 < r and using Observation 2, we can easily show that 
T(n, r) = 0(log r(log r + log log *n )) 

Regarding the work, we obtain the following expression. 

W(n, r ) = kP(n, r 1 ).r 1 +fc 1 .P(n-a, r 2 ).r 2 +fc 2 .P(n--a, r 2 ).r 2 log r 2 +A; 3 .P(n, rx).rx log 
A: 4 .P(n, ri).n + P(n, r).r 

where k,ki,k 2 ,k 3 and k 4 are constants. 

By using Eq. (3.4) and Eq. (3.5) and since r x < r and r 2 < r and Observation 2, 
the above expression can be simplified to 

W(n,r ) < k.P(n,r).r + ki.P(n,r).r + k 2 .P(n,r 1 ).ri \ogr 2 +k 3 .P(n,r 1 ).ri logr x + 
k 4 .P(n,ri).n + P(n,r).r 
Let us consider 

P(n, r )/P(n, r,) = = (n - r.) . . . (n - r + 1) 

This expression will have r — r x terms. Since r < | and r > r x it follows that 

■P(Tt,r) ^ n 
■P(n, ri) — 2 ‘ 

We know that logrx < 

Hence, the expression for W(n,r ) can be simplified to 

W(n,r ) < A:.P(n, r)r + fcx .P(n,r)r + k 2 .P(n,r)r + k 3 .P(n,r)r -|- k 4 .P(n,r)r + 
P(n, r)r 

Hence, W(n,r) = 0(P(n,r).r). 

Now, we consider the other case, 

Case r > ^ 

The expression for time complexity is 

P(n, r) = 0(log rx (log r x + log log *n) + Cj . log r 2 + c 2 + c 3 . log n 
where ex, c 2 , and c 3 are constants. 

Note that since r > n is 0(r). 

As rx < r and r 2 < r and from Observation 2, we can easily show that 
T(n, r) = 0(log r(log r + log log *n)) 
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Regarding the work, we obtain the following expression. 

W(n, r) = kP(n , r 1 )r 1 +A: 1 .P(n— a, r 2 ).r 2 +fc 2 ..P(n— a, r 2 ).r 2 log r 2 -f-& 3 ..P(n, rx).n+ 
P(n,r).r where k,ki,k 2 and fc 3 are constants. 

By using Eq. (3.4) and Eq. (3.5) and since rj < r and r 2 < r and Observation 2, 
the above expression can be simplified to 

W(n, r) < k.P(n, r).r+fc 1 .P(n, r).r+fc 2 .P(n, r 2 ).r 2 log r 2 +fe 3 .P(n,rx).n+P(n, r).r 
Note that by Observation 2, r 2 < |. 

Let us consider 

P(n, r)/. P(n, r a ) = $$$=* $ = (n - r 2 ) . . . (n - r 4 1) 

This expression will have r — r 2 terms. Since r > r 2 and r 2 < | it follows that 

P(n,r) ^ n 
P(n,r 2 ) - 2‘ 

We know that logr 2 < j. 

Hence, the expression for W(n,r ) can be simplified to (by using the fact that n is 
0(r)). 

W(n, r ) < k.P(n , r).r + ki.P(n,r).r + k 2 .P(n,r).r + k$.P(n,r).r + P(n, r).r 
Hence, W(n,r ) = 0(P(n,r).r). 

By combining the above two cases and Lemma 3.5, we obtain the following theorem 

Theorem 3.7 The r-permutations of n objects can be generated in lexicographic order 
in time 0(log r(log r+log log *n)) with optimal work 0(P(n , r).r) on the CREW PRAM. 

Using Lemma 3.6 we can show that 

Theorem 3.8 The r-permutations of n objects can be generated in lexicographic order 
in time O(logr(logr + a(n))) with optimal work 0(P(n,r).r) on the CREW PRAM. 

3.3 The n-Recursive Algorithm 

n this section, we see another algorithm for generating permutations which is also based 
n induction and recursion. 
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3.3.1 Basic Algorithm 

This algorithm is based on giving an algorithmic interpretation to a well known combin- 
atorial identity. This reinforces our idea that algorithmic interpretation of combinatorial 
identities provides a good basis through which we can design parallel algorithms. 

Our algorithm is based on Vandermonde’s Convolution for permutations [37], 

'^2P(mi,k)C(r,k)P(m 2 ,r — k ) = P(mi + m 2 ,r) (3.10) 

k 

We use a special case of this identity when mi = | and m 2 = | shown below 
(assume n is even), 


E P& k)C(r, k)pA r ~k) = P(n, r) (3.11) 

k=0 z Z 

Our algorithm is based on the following algorithmic interpretation to the above iden- 
tity. 

Suppose, we are interested in generating r-permutations of n objects {1,2, . . . ,n}. 

Let A = (aio 2 . . . a r ) be an arbitrary r-permutation Let there be k objects from the set 
{1,2,..., in A; r — k objects will be from the set {§ + 1) f + 2, . . . ,n}. Let us put 
the k objects in the same order as they are in the permutation A. The places that are 
occupied by these k elements are a fc-combination of the set {1,2, . .. ,r}. The places 
occupied by the other r — k elements correspond to the complement r — ^-combination 
of the above ^-combination. In other words one term in the Eq. (3.11) represent one 
possibility for k. Different values for k lead to different r-permutations. Note that k can 
have a value from 0 to r only. 

Based on this interpretation, we get the following algorithm for generating r-permutations 
of n objects {1,2, ...,n}. We generate fc-permutations for the first set of | objects 
{1,2,..., |} and r — A:-permutations for the other set of ^ objects {| + 1, . . . ,n}. We 
also obtain the ^-combinations of r objects. Then we put each item of ^-permutation 
in place specified by the /c-combination. For each such placement we can place r — k- 
permutations in the remaining places (places specified by the corresponding complement 
r - fc-combination). We can generate P(|, k).C(r, k).P( |,r - k) r-permutations for 
any given value of k. Next vary k to generate all the r-permutations of n objects. It is 
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easy to see that every r-permutation will be definitely generated for some value of k in 
the range 0 to r. 

The algorithm given in this section makes the following assumption. 

Assumption: n must be a power of 2. 

We will relax this restriction in Section 3.3.2. 

By eliminating the zero terms in identity (3.11) using Eq. (3.3) we get 

t P & *)C(r, r - k) = P( n, r) (3.12) 

k=0 z z 

n 

£ *) ^ r - *) = P(n, r) (3.13) 

k=r - f Z Z 

if r > f . 

Not surprisingly in the above equations the range of k depends on the value of r. 
Each term in the above identity represents two recursive calls. If one of the them 
produces zero permutations then this means that we have unnecessarily generated both 
the recursive calls whose result we are not going to use. So we eliminate zero terms 
from Eq. 3.11 while forming above equations. Note that in the above identity the call to 
generate i-permutations for j objects occurs only once for applicable i and j. 

In identity (3.12) and (3.13) each product is a product of three terms. Two of them 
represent recursive calls and the other term specifies the combinations that are needed. 
In our algorithm, we first generate all combinations before proceeding further with the 
recursive calls. We generate all the i-combinations for j objects {1,2, ...,y} for all 
1 ^ hj £ r ( see Section 3.3.1). Now, we would like to know what are the specific 
recursive calls that will be made in such an algorithm. It will be useful in the design of 
our parallel algorithm. In the lemma below, by a recursive call of i-permutations of j 
objects, we mean any recursive call which occurs such that it generates i-permutations 
of some set of j objects. 

Lemma 3.9 Suppose, we are generating r-permutations of n objects , where n is a 
power of 2, using Eqs. (3.12), (3.13). As part of the recursive algorithm when we 
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generate the p-permutations of m objects then m is power of 2, m < n, and p < 

min(m : r). 

Proof: The proof is based on the observation that whenever we use Eqs. (3.12) and 
(3.13), we have eliminated all zero terms in the above identities. More over, in all 
recursive calls, whenever we are generating ^-permutations for | objects then q < r. 
This applies for every recursive call. Thus, p <r. 

It is given n is a power of 2. It is not difficult to observe that as the recursive calls 
are for j objects, whenever we are generating p-permutations for m objects as part of 
the complete recursive algorithm, m must also be a power of 2. 

If m and p are positive integers P(m,p ) = 0 only when m < p. As there are no zero 
terms in our identities, it follows that p < m. 

Since p <m and p < r, it follows that p < mm(m,r). Hence our claim is verified. 

I 

As the identities (3.12), (3.13) indicate, we have a number of recursive calls for 
generation of r-permutations and these recursive calls satisfy the restriction as proved. 
We have to use parallel recursion, when the number of recursive calls that are to be made 
are more than one. We avoid parallel recursion by executing the algorithm bottom-up. 
Thus, we first execute all the calls to obtain the permutations for 1 object. Then we 
obtain the permutations for 2 objects and so on. We tackle processor allocation details 
for bottom-up execution in pre-processing. In the pre-processing itself, we will find what 
processor will do which work for the entire main processing. The complete algorithm is 
shown below. 

Pre-Processing 
// Calculate i! for 0 < i < n 

1 for i = 1 to n in parallel do 

A [i] = i; 

2 Prefix-mult (A) ; 

A [0] = 1; 

// Calculate values of C(i,j), P(i,j) for all 0 < *, j < n 

3 for i = 0 to n in parallel do 
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for j = 0 to n in parallel do 

if i < j then com[i,j] = 0, perm[i,j] = 0 
else com[i,j] = » P erm ^ .j] = 

// Generating the the i-combinations of j elements {1,2,...,^} for 1 < i , j <r 

5 for i * 1 to r in parallel do B[i] = 2 V; 

6 B1 = Pref ix-sum(B) ; 

7 for i = 1 to r in parallel do 

start [i] = Bl[i-1]+1; 
size[i] - B[i]; 

end[i] = start [i] + size[i] -1; 
p = Bl[n] ; 

8 Generic-Processor-Allocation; 

9 Generate all the i-bit binary numbers for 1 < i < r; 

10 Find the combination, complement combination corresponding to each binary 
number using two applications of prefix sum by finding position of l's, 
and 0's respectively; 

11 Rank each combination; 

Put each combination at its index in the list corresponding to its 
combinations. Take the complementary combination along with it; 

// Pre-processing for Processor allocation of main processing 

12 Create an array C of length (logn — l)r(r + 1) . The locations ((i-i)r (r+l))+l to 
ir(r+l) correspond to processor allocation details for level i. If a level i 
starts at position START then the processor allocation for generation of 
m-permutations of level i corresponds to locations START + (m-1) (r + 1) to 
START + m(r+l)-l, where 1 < m < r. 

13 D = Pref ix-sum(C) ; 

14 for i = 1 to (logn — l)r(r + 1) in parallel do 

start [i] = D[i-1]+1; 
size[i] = C[i]; 

end[i] = start [i] + size[i] -1; 

Total = p = D[(logn - l)r(r + 1)] ; 
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15 Generic-Processor-Allocation; 


' Algorithm Generate JPermutat ions (n , r) 

Begin 

16 Generate 1-permutations of 1 object {1} and object {2} 

17 for i = 1 to logn — 1 do 

Generate all the permutations related to set of 2* 

objects and for an adjacent set of elements of the same size. 

18 Processor allocation for top level; 

19 Generate the r-permutations of n objects; 

End. 


Pre-Processing 

In case of main processing we need the values of binomial coefficients and values of 
P(i,j)'s at number of places. We will calculate all the values that are needed and store 
them. 

This we have done in the pre-processing as follows. Apply prefix multipiication[25] 
on the array A already initialized with A[i] = i. After prefix multiplication, A[{] = {!. 
So, once we have calculated the factorial values we use Eq. (3.7) to calculate C(i,j)’s 
and Eq. (3.1) to calculate P(t, j)’s for 0 < i,j < n. 

Generation of Combinations 

For generation of combinations using Lemma 3.9 observe: 

Observation: If we need {-combinations of j elements in the bottom-up version of 
recursive algorithm then i < r and j < r. 

We generate all the {-combinations of j elements for all 0 < i,j < r. This means 
that we have to generate all combinations of r elements and all the combinations of r — 1 
elements and so on. But note that for each combination we also need its complement 
combination (the complement combination of a p-combination of q objects, S' is a q-p- 
combination containing all the elements which are in S but not in the p-combination.) 

If we are interested in generating all the combinations of k elements, generate all the 
A-bit binary numbers. Each binary number corresponds to a combination specified by the 
positions of l’s[33]. The positions of 0’s corresponds to the corresponding complement 
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combination. 

As we need to generate combinations for k elements for k = 1, 2, . . . , r, it implies 
that we have to generate all 2 k fc-bit binary numbers where k varies from 1 to r. We 
generate all binary numbers that are needed at once. Obviously we need k processors 
to generate a fc-bit binary number in constant time. Note that the j'-th (counting LSB 
as 1) bit of a A;-bit binary number B is given by (J3 mod 2 J ') div 2 J_1 . So, using 
this expression, we can obtain the binary numbers. But to generate all the fc-bit binary 
numbers we need 2 k .k processors for each k from 1 to r. This is not straight forward to 
do as it is difficult for a processor to know its work. There is a necessity for processor 
allocation. 

To, ease the processor allocation, we allocate r processors instead of k, for each k - bit 
binary number. The extra processors remain idle. We can imagine the generation of all 
the &-bit binary numbers for a given k as a task. Hence there are r tasks, such that 
the z-th task needs 2 \r processors. Based on this idea, we form an array B such that 
B[i] = 2 *.r . We apply prefix sums on this array getting the array B 1. Now we identify 
for each task what are the processors that are needed (see Step 7). Then, we apply the 
generic processor allocation (see Section 2.3), from which we obtain arrays G and N 
such that G[j ] gives the task for which processor j works and iV[j] returns the index of 
the processor j among all the processors that are allocated to task G\j]. 

Once, processor allocation is done, we will generate all the binary numbers as de- 
scribed above. The task that remains is to obtain the combinations and complement 
combinations corresponding to each binary number. So, we need to identify the position 
of each 1 (among all the Is) and 0 (among all Os). This can be easily done using two 
applications of prefix sums. 

Note that in generation of permutations we need all the combinations of same length 
for a given set of elements in sequence. So, our next task is to put together all the 
^-combinations for j elements for all 0 < j,p < r at one place. This can be done using 
ranking. As explained in [3] ranking of a ^-combination can be done using summation of 
k values. We are ranking only the combinations but not their complement combinations. 
We put all the p-combinations of j elements at a place denoted by its rank, we also 
take its complement combination along with it. When this step is finished, we have got 
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together all the combinations of the same length for a given set of elements at one place 
(in consecutive locations). 

Main Processor Allocation 

We refer the generation of permutations for a particular number of objects as one level. 
The zth level corresponds to the generation of permutations for 2 l objects. So, there 
are logn + 1 levels in all from 0 to logn. The level where we are generating the 
permutations for n objects will be referred to as the top level. Similarly, the level where 
we are generating the permutations for 1 objects will be referred to as the bottom level. 

Based on Lemma 3.9 we generate all calls such that, for a given level i, we generate 
p-permutations where p varies from 1 to r. But as we show later whenever p > 2\ no 
processors will be allocated to this call and in effect the call will not really take place. In 
accordance with the above idea we will set up processors so that we will execute all the 
calls as indicated above. All the calls related to a particular level of recursion will execute 
simultaneously. So, processor allocation should be such that the same processors from 
one level will be used in the next level. 

The processor allocation for a particular call will be based on the Eqs. (3.12) and 
(3.13). Hence the above equation for the present case provides us with details of how 
to form the given set of permutations for a given set of objects and also the number 
of processors needed and how we should distribute them. But we should recall that the 
above Eqs specifies only the number of permutations and not the number of processors 
that we should devote. But obviously, we will be allocating p processors for each p- 
permutation. If we multiply by p for the equation to generate p-permutations that will 
suffice in terms of processor allocation. 

Except the top and bottom levels, the remaining levels will be considered in a uniform 
fashion. For all levels except the top level, we calculate all the p-permutations forp varying 
from 0 to min(m,r) where we want to generate these p-permutations for m objects. 

For each level of recursion, we will try to find the number of processors needed 
for p-permutations of m objects where p varying from 1 to r. Note that according to 
Lemma 3.9, p should vary from 1 to mm(m,r) and not r. But our modified range for 
p simplifies the processing with no change in work. 

There are logn — 1 levels for which we have to do processor allocation - level 1 to 
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level logn — 1. For each level, there will be r recursive calls. We create an array C of 
length (logn — l)r(r + 1) (recall each recursive call has r+1 parts based on Eq. (3.11)) 
such that the locations (i — l)r(r + 1) + 1 to ir[r -j- 1) correspond to level i. Suppose 
level i starts at START then the processor allocation details for the jth call in level i 
correspond to locations START + (j - l)(r + 1) to START + j(r + 1) - 1. These 
locations will be filled based on Eq. (3.11). Note that even though we are not using 
Eqs. (3.12), (3.13), the extra locations will contain zeroes and hence no processors will 
be allocated to them any way. 

Apply prefix sums on array C. Let the result be in D. We consider each location of 
D as specifying a task to be done, with the needed number of processors as specified in 
the array D. Based on this we apply generic processor allocation (see Section 2.3). The 
calculation of the arrays needed like start, end and size and the value p are specified 
in the algorithm (see Step 14). Once generic processors allocation is done, we will get 
the arrays G and N from it. 

From now onwards, we refer the array G as Alloc and the variable p by Total which 
denotes the total number of processors that are used in the (logn — 1) levels. 

The idea behind the array Alloc is as follows. Let of,- denotes the number of processors 
we need for level i. More over let e t - ’s denote the prefix sums on array d,-. Observe 
that e,’s can be obtained from the array D. The first d\ locations of the array Alloc 
provide the processor allocation details for level 1, similarly the next d 2 locations provide 
the processor allocation details for level 2 and so on. In other words, the locations of 
Alloc array, e t _x + 1 to e,- provide the processor allocation details for the level i (assume 
e 0 = 0.). For level i, d t - processors will be knowing about work assigned to them by 
looking at locations e,_i + 1 to e,- of Alloc in order of the processors (1 st processor 
looks at the location e,-_i + 1, 2nd processor looks at the location e,_i -f 2 and so on.). 

We indicate below how a given processor finds the work assigned to it. Suppose a 
processor numbered j is assigned to the location i of the array Alloc. Suppose Alloc[i] 
contains q. Suppose the processor is assigned to the generation of ^-permutations. The 
level in which we are operating is already known as the algorithm proceeds sequentially 
in terms of levels. Let us also assume that of the fc-permutations the processor belongs 
to t th part of the fc-permutations.( Recall that each ^-permutation's call has r + 1 parts; 
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though some parts may be null, processors will always be assigned to useful parts only). 
Suppose this i-th part needs some number of processors. So we would like to know what 
is the number of our processor out of the processors that are allocated for the part t. 
This is W[ij. Once this is known, we can easily identify the work that should be done by 
our processor. 

Main Processing 

We generate 1-permutations for 1 object {1} and {2} to start our processing as they 
are the base cases in the recursion. The processing for the next first logn — 1 levels is 
similar. So we describe below the processing for an arbitrary level. 

Let us assume we are generating permutations for the i-th level; we will be gen- 
erating permutations for 2‘ elements. There will be two such sets of 2* elements. 
More precisely we will be generating permutations for the set {1,2,..., 2’} and the 
set {2* + 1, 2* + 2, . . . , 2 ,+1 }. For the sake of simplicity, let us denote 2’ by w. So, we 
are generating permutations for first w elements and the next w elements. As we are 
generating permutations for w elements, we will be generating p-permutations of these 
w elements (and the other set of w elements) for p varying from 1 to min(w,r). So, 
there will be mm(to,r) calls in all. 

From Eq. (3.11), we can observe that, when we want to generate the p-permutations 
of m elements, we need permutations from the two sets of elements, viz, the first set of 
m/2 elements and the second set of m/2 elements; lengths of the permutations that are 
needed from these two sets are same as Eq. 3.11 is symmetric with respect to its first 
and second set of elements. The following observation is useful in such situations where 
we need the same lengths of the permutations for different sets of same cardinality. 
Observation: If we have-with us all the p-permutations of the elements {1,2,..., n}, 
then to generate the p-permutations of the set of elements {1 + 6, 2 -f b , . . . , n + 6}, 
we add b to each element of each permutation. 

If we have the p-permutations of one set of elements the p-permutations of the 
adjacent set with the same size can be easily generated. Coming back to our original 
discussion, we are interested in generating the p-permutations for w elements and for 
the adjacent w elements. We do not generate the p-permutations for these two sets 
independently. One processor will be responsible for one element of a permutation for 
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the first set of w elements. Now, that processor apart from doing its original duty, adds 
w to its value (which it is storing in its corresponding location) and stores that value 
in the corresponding location associated with the p-permutations for the other set of 
elements. 

We now briefly describe how the processors are allocated and are doing their job. For 
each level, there are corresponding contiguous locations in the array Alloc. From the pre- 
processing we also know, the number of processors needed for each level. For level i, we 
need Z)[zr(r + 1)] — jD[(i — l)r(r + l)] processors. So we allocate that many processors for 
a given level and the processors identify their work by consulting their assigned location 
in Alloc. Processor j is associated with the location f = — l)r(r + l)]+ j of Alloc. 

From that they get the needed information. Once the processor knows to which part of 
p-permutations it is allocated, and its number with respect to the processors that are 
allocated for a given part i.e N\j'}, then the processor copies the information from the 
previous permutations calculated for the last level of processing. Suppose the processor is 
allocated to part P(w/2,k)C(p,k)P(w/2,p — k)] i,e, P(w/2,k)C(p,k)P(w/2,p — k)p 
processors are needed for this part and these processors copy the fc-per mutations from 
the first set of w/2 elements placing them in locations identified by the combination 
and p — fc-permutations from the second set of w/2 elements and placing them in the 
corresponding positions indicated by the complement combination in a multiplicative 
fashion. 

More precisely, We take each A:-permutation from the first set of w/2 elements and 
place it in the positions indicated by /c-combinations of p elements {1,2,... ,p} and for 
each such placing, we take all the p — ^-permutations of other set of w/2 elements and 
place them in locations specified by the corresponding complement p— fc-combination of p 
elements {1,2, . . . ,p}. So, there will be P{w/2, k)C{p,k)P(w/2,p- k) p-permutations 
in all for all the possibilities. 

The locations where we have to store these p-permutations will be obtained from 
the array D. Once a processor knows its number with respect to the part of the p- 
permutations, it proceeds as follows. It first identifies what is thep-permutation in which 
it is going to participate. Then it identifies whether it should retrieve an element from 
the fc-permutations of first set of w/2 elements or the p - A-permutations of the second 
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set of w / 2 elements. Suppose it has to copy the j-th element (let it be a') of the k- 
permutation of first set of w/2 elements. It has to note where it should store its element 
in the p-permutation it is building. This will be identified by the ^-combination that is 
associated with that p-permutation. Then it consults the j-th item of that combination 
(let it be b ') and it stores a 1 in location b 1 of the p-permutation. 

On the other hand, suppose it has to store the j-th part of the p — fc-permutation of 
the other set of w/2 elements, then the approach as indicated is applicable except that 
we use the corresponding complement combination instead of the normal combination 
to know the location; recall that when we were storing combinations, we store for each 
combination its complement combination along with it. 

In both the above cases, the processor adds w to its element and writes that in the 
position corresponding to it in the p-permutations for the adjacent set of w elements. 
The way to identify details like what permutation a processor is associated with, what is 
the element it should retrieve and where it should store are not difficult to obtain, once 
we have the information obtained from pre-processing. 

For the space allocation, we will have two four dimensional arrays. The first array 
will be for the first set of elements. The second array will be for the permutations cor- 
responding to the adjacent set of elements. The first dimension of the array correspond 
to the level of bottom up processing. The second dimension corresponds to the length 
of permutations, the third dimension correspond to the number of permutation and the 
fourth dimension corresponds to the actual permutations elements. 

Once we have come to top level we have generated all the needed permutations for 
the first set of ^ elements and the second set of ^ elements. Now we have to calculate 
the r-permutations of the complete set of n elements from these permutations. We first 
allocate processors followed by the generation of permutations. We proceed in a similar 
manner to processor allocation in pre-processing by using the identity (3.12) or the 
identity (3.13) which ever is applicable. Then we can get r-permutations for n objects. 

Now, we analyze the algorithm. Consider the pre-processing part of the algorithm. 
Initially we are calculating the values of C{i,j)’s and P(i,j)’s for 0 < i,j < n. These 
are found by finding z! for 1 < t < n using prefix multiplication. This takes a time of 
O(logn) with linear work [25]. In Step 3, we are calculating the values of C(i,j) and 
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P{hj) respectively in constant time with n 2 processors. 

Later, we are obtaining all the combinations for k elements for k = 1,2 In 
Step 5, we are building the array in constant time with n processors which is useful for 
processor allocation. In Step 6, we are finding the prefix sums of the above array into Bi 
in O(logr) time with 0(r ) work. In Step 7, the arrays which are needed for processor 
allocation are formed. These arrays are obtained in constant time with r processors. 
Note that p = £i=i 2’.r = r. 2 r+1 

In Step 8, generic processor allocation (see Section 2.3) is invoked to get the arrays 
G and N . By Theorem 2.3 this takes a time of O(loglog *(p)) i.e O(loglog*(r.2 r+1 ) = 
O(logr) with 0(p ) work on CREW PRAM. 

In Step 9, all the needed binary numbers are generated in constant time with p 
processors. In Step 10, the combination and the complementary combination for each 
binary number are obtained using prefix sums. Note that the prefix sum for each binary 
number will go independently and simultaneously with that of others. This step takes a 
time of O(logr) with 0(2 r+1 rlogr) work. In Step 11, we are ranking each combination 
in O(logr) time. In Step 11, the combinations are stored at the index specified by 
their rank in constant time with a work of 0(2 r+1 r logr). Note that 0(2 r+1 rlogr) is 
0(P(n, r)r). 

Now we look at main processor allocation. In Step 12, we formed the array C which is 
useful for processor allocation. The array stores the information for all the recursive calls 
that will be made in algorithm. It is based on Eq. (3.11). Of logra — 1 levels of recursive 
calls, each level has got min(p,r) calls if we are generating permutations for p objects. 
But the number of arrays we are filling is r for each level for simplicity. From Eq. (3.3), 
all the extra arrays and extra locations will contain zeroes. So, in processor allocation we 
won’t be allocating processors to them. Thus, the array C is of length (logn — l)r(r+l). 
Filling up C can be done in constant time with 0(log nr 2 ) processors. 

In Step 13, we are calculating the prefix sum of array C into D in 0(log(log n.r 2 )) = 
0(log logn 4- logr) time with a work of (9(log n.r 2 ). 

In Step 14, we are forming arrays for doing processor allocation using generic pro- 
cessor allocation. The variable Total is the final summation value in the prefix sums we 
have calculated above. We later show that this value is bounded above by 2.P(n,r)r. 
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The last step follows from the following. 
Consider P(2n,r)/P(n,r) when r > 1. 


P(2n, r)/P[n, r ) 

So, P(2n,r)/P(n,r) > 2. 
Coming back to LHS, 


2n{2n — 1) , (2 n — r -f 1) 
n(n — 1) . . . (n — r + 1) 


LHS <2P(2n,r)r 


So, in this case our lemma is proved. 


Case 2: r > n. 


(3.14) 


LHS = Efco 1 E”)f ,r) PVM+ZT^ PM-J = Eii 1 E?LoP(2'', j).j+ 
LU = Etc E~; ,J ‘ n) P(2‘J)-i + E”=o P(n,i)J 

Using induction hypothesis and Eq. (3.12), 

LHS < 2P(n, n)n + P(2n, n)n < 2 P(n, n)r + P(2n, n)r, as r > n. 

Continuing, 

LHS < r(2P(n,n) + P(2n,n)) < r(P(2n,n) + P(2n,n)) 

This step follows from Eq. (3.14) 

So, LHS < 2P(2n, n).r < 2P(2n,r).r, based on Eq. (3.5). 

So, our claim is valid in this case also. 

Thus, the lemma follows. 1 

We now take up the analysis of our main processing. We generate permutations 
related to the logn levels. For the level i, we generate p-permutations of 2‘ objects 
where 1 < p < min(2 i ,r). More over we generate the permutations for two such 
adjacent sets. 

Each level takes constant time. The number of operations in the level i are 

2[E”=o <2 ' , ’' ) P(2‘,j)j] 

We have logn levels, excluding the top level. Hence the sum of operations of all 
these levels put together is 
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2E&0 1 Z?^' r) P(2,M where n = 2*. 

But from Lemma 3.10, we note that the above sum is bounded above by 4P(n, r)r. 

Since there are logn levels in all each taking constant time. This part takes 0(log n) 
time. 

Now, we have to look at the timing and work details of the top level. We allocate 
the processors by means of Generic processor allocation problem (see Section 2.3) using 
Eq. (3.12) or (3.13) whichever is applicable. This is similar to the way we have done 
processor allocation in the pre-processing. 

So, the processor allocation takes a time of 0(loglog*n -f log log *r) time and the 
number of operations are 0{P(n,r)r). This step runs on the CREW PRAM. 

Now, we consider the generation of r-permutations of n objects in the top level. This 
step takes constant time. The number of operations are 0(P(n,r)r). 

We summarize in the following theorem. 

Theorem 3.11 The algorithm runs optimally with a time of 0 {logn) and the work is 
0{ P(n , r).r) on the CREW PRAM when n is a power of 2. I 


3.3.2 Generalization of the Algorithm 

In the earlier section, we have seen the algorithm to generate r-permutations of n objects 
when n is a power of 2. We will remove that restriction in this section. The algorithm 
given in this section works only when n is not a power of 2. It heavily makes use of our 
earlier restricted algorithm. 

Like our earlier algorithm, this algorithm is also based on special cases of Vander- 
monde's convolution. 

Define x = [|] and y = [_fj 

Consider the following application of Vandermonde's convolution. 


£ P(x, Jfe)C(r, k)P{y, r — k) = P{x + y, r) = P{n, r) (3.15) 

fc = 0 

So, we would like to generate the r-permutations of n objects using the permutations 
of x objects {1,2,...,®} and that of y objects {x + l,x + 2,.. .,n}. In the above 
equation we eliminate the zero terms considering r with respect to x and y 



, HfKm 
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Consider, 


E P (*, k)C( r, k)P(y, r -k) = P(u, r) (3.16) 

jfc=0 

if r < y. 

tf(,,l)C(r,t)f(l,r-l) = f( V ) (3.17) 

k=0 

if r > y and r <x. 

E P(y,k)C(r,k)P(x,r - k) = P(n,r) (3.18) 

k=r~x 

if r > x. 

As x = |"|] and y = [|J observe 

Observation: 

1. x > y 

2. x — y + 1 if n is odd 

3. x = y if n is even 

4. x + y = n 

So, the idea behind our algorithm is that we generate the ‘needed’ permutations of 
x objects and similarly the needed permutations for y objects and combine them using 
above applicable equation to generate the r-permutations of n objects. By ‘needed’ 
permutations we mean the permutations that are needed in the above equations depending 
on the case which is applicable. For example, if r > x then we need to generate the 
fc-permutations of x objects for r — y < k < x and fc-permutations of y objects for 
r — x < k < y. But in any case, the following observation is quite useful throughout our 
algorithm and its proof of correctness. It follows from the above equations. 
Observation 4: In our algorithm, whenever we generate p-permutations for some 
set of objects of cardinality q then the following properties are obeyed. 

1. p <q 
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2. p <r 

3. p> 0 

We show how we go about generating the needed permutations for x objects and 
that of y objects. 

We use the following abbreviations in our presentation. 

We “ copy fc-permutations of a objects where for all k, l x < k < l 2 by adding e to 
each element" for the following procedure. 

We consider copying the fc-permutations of a objects by adding e to each element for 
a particular value of k as a task; we have l 2 — h + 1 tasks. The i-th task involves copying 
of the l x + i — 1-permutations. Obviously, the i-th task needs P(a,l x +i — 1 ).l x +i — l 
processors. We make A[i] — P(aJ x + i — 1 )(/ x + i — 1) for each i. Then we apply 
prefix sums on array A in 0(log(/ 2 — h + 1)) time with 0(l 2 — l\ + 1) work. Using 
this information, we apply our generic processor allocation to allocate processors. Let us 
denote by Sum the expression X^L.^ P(a,i).i 

For generic processor allocation, the time taken is 0(loglog *(Sum)) with O(Sum) 
work on CREW PRAM. So, the total time taken is 0(loglog*(5um) +log (/2 — h + 1)) 
with 0(Sum + 1? — 1 1 + 1) work on CREW PRAM. 

By "processor allocation for fc-permutations of a objects where for all k, l x < k < Z 2 ” 
we mean the following procedure. 

We would like to generate the ifc-permutations of a objects using Vandermonde’s 
convolution; the special case specified as part of the above statement. So, we need to 
allocate the processors for these l = l x — l 2 + 1 calls. For this, we first form an array 
C of length /(/ 2 + 1) such that the locations [i - l)(/ 2 + 1) + 1 to i(l 2 + 1) are for i th 
call. We fill the locations using the Vandermonde’s' convolution and note that the extra 
locations we are filling will contain zeroes. (Since for generating i-permutations we need 
at most i + 1 locations in Vandermonde’s convolution) . After that we apply prefix sum 
on this array and then apply generic processor allocation to get the data structure for 
processor allocation. 

Keeping this notation in view the algorithm given below specifies formally generation 
of r-permutations of n objects. 
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Pre-processing 

Calculate i! for 0 < i < n. 

Calculate C(i,j)'s, P(i, j) 's for 0 < i, j < n. 

Generate the i-combinations of j objects for all 1 < i,j < r. 


Algorithm Generate_Permutations_generalized(n ,r) 

Begin 

1 = ffl; y= lib 

// Generate the permutations for x objects 

x = a + b where a is max power of 2 such that a < x. (a = 20 

» 

Processor allocation for the generation of k-permutations of 2* objects 
where k varies from 1 to min (2% r) and i varies from 0 to t. 

Generate k-permutations of 2 l objects where k varies from 1 to 
min(2*,r) and i varies from 0 to t. 

Copy k-permutations of a objects for 1 < k < 
adding a to each element. 

Identify all elements greater than x as a dummy element and find 
for each permutation whether it contains dummy elements or not. 

Rank all the permutations which do not have dummy element. We have got 
the k-permutations of b objects where k varies from 1 to min(b,r). 

Processor allocation for generation of permutations of x objects. 

Generate the permutations of x objects using the 
permutations of a objects and that of b objects. 
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// Generate the permutations of y objects 


Copy the k-permutations of a objects where k varies from 1 
to min(a,r ) by adding x to each element. 

Generate the k-permutations of b-1 objects using the above 
generated permutations using ranking. 

Processor allocation for generation of permutations of y objects. 

Generate the permutations of y objects using the 
copied permutations of a objects and that of b-1 objects. 

// Generate the r-permutations of n objects 

Generate the r-permutations of n objects using the 
permutations of x objects and that of y objects. 

End. 

We first explain the pre-processing part of the algorithm. In the pre-processing we 
find (a) il, (b) C(i.j)'s and (c) P(i.j)’ s for 0 < i,j < n. Later we are generating 
the i-combinations of j objects for 0 < i, j < r. These are already explained in our 
earlier algorithm. From that algorithm we understand that, the pre-processing can be 
accomplished in O(logn) time with 0(n 2 + 2 r+1 rlogr) work. 

Now, we look at the generation of permutations for x objects and the permutations 
for y objects. We first look at the generation of permutations for x objects. We indicate 
how it can be modified to generate the permutations for y objects later, which is similar. 
Generating Permutations for x objects {1,2,..., a:} 

We express x = a + b where a is defined as the largest power of 2 such that a < x. 

Let a — 2 t for some integer t. The following observation is not difficult to make. 
Observation: 

1. a < x 
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2. a > b 


3. b> 0 

Note that if x is a power of 2 then a = b. 

The permutations for x objects we will obtain by using the permutations of a objects 
{1,2, . . . , a} and the permutations of b objects {a + 1, . . . , x}. That is, we are using the 
following application of Vandermonde’s convolution for generation of fc-permutations of 
x objects. 

J2P(a,i)C(k,i)P(b,k- i) (3.19) 

i=0 

We proceed as follows. We initially generate the ^-permutations of a objects where 
k varies from 1 to min(a,r). Later we generate the ^-permutations of b objects where 
k varies from 1 to min{b,r). Note that the length of permutations i,e, k, we need from 
these a objects and b objects will not be outside this range. This follows because if 
it is outside then either the length exceeds r (which is not possible; see Observation 
4) or length exceeds the number of objects in the set, in which case the number of 
permutations are zero (which does not arise as we have specifically avoided zero terms 
in our identities). 

Now, we look at the generation of permutations for a objects. 

Generation of Permutations for a objects {1,2,..., a} 

Recall that in our earlier algorithm, if we are generating the mm(c, r)-permutations for 
2 a objects, (note that 2 a is a power of 2), then we first generate the ^-permutations for 
2‘ objects where k varies from 1 to min(2',r) and i varies from 0 to t (Recall a = 2‘). 
Later on we generate the r-permutations of 2a objects. The time taken is O(loga). 

In the present case, we generate the fc-permutations for 2‘ objects where k varies from 
1 to min[2\r) and i varies from 0 to t. This involves processor allocation followed by 
the generation of permutations. But processor allocation and the generation have same 
resource bound for work. The total work for the generation of permutations of a objects 
is: 

w = eLo ET=o (2 ' r) p ( 2i J)-J 

To bound this sum, we consider two cases. 
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Case 1: r <2a 


Using the Lemma 3.10, the above sum can be bounded as follows. 
W < 2.P(2a, r).r < 2 .P(n,r).r 
since a < x, 2a < n. 


Case 2: r > 2a 


W = Zlo = TU E&o P (2‘, j) j = SU ESS 12- ' 2 *’ P(?,3).j < 


mtn(2 l ,2a) 


2P(2a,2a)2a 

In the last step we used Lemma 3.10. Further, 

W < 2.P{2a,2a).r < 2.P(n,2a).r < 2.P(n,r).r 

The second step follows because r > 2a and the third step follows because 
n >2a and the last step follows because 2 a < r <n and using Eq. (3.5). 


Thus, generation of permutations of a objects is bounded by 0(P(n,r).r). The time 
taken is O(loga). 

So, we have with us the ^-permutations of a objects {1, 2, . . . , a} for all k, 1 < k < 
mm(a, r). Using them we generate the ^-permutations of b objects {a + 1, . . . , z} for, 
1 < k < min(b, r). 

Generation of Permutations for b objects {a + 1, a + 2, . . . , x} 

We first copy the A:-permutations of a objects adding a to each element where k varies 
from 1 to mm(6, r). (Recall that a > 6.) Now, we have with us the ^-permutations of a 
objects {a + 1, a + 2, . . . , 2a} where k varies from 1 to mm(6,r). From these we would 
like to generate the A:-permutations of b objects {a + 1, a + 2, . . . , x}. So, if a = b, then 
since a + b = x, it follows that 2 a = x and we are done. 

On the other hand, if a is strictly greater than b, then the following approach is used. 
If we have with us the ^-permutations of a objects {a 4- 1,. .. ,2a}, it contains all the 
fc-permutations of b objects {a-f 1, a+2, . . . , x} one and only once since x < 2a. So, the 
remaining fc-permutations contain at least one element from the set {x + 1, x + 2 . . . ,2a} 
(from now onwards we call them dummy elements). 

So, we assign k processors to each ^-permutation of a objects {a 1, a + 2 . . . , 2a} 
where k varies from 1 to min(b,r). In the first step these k processors are assigned 
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i such a way that one processor is assigned to one element of the permutation and it 
hecks whether the element it is looking at is a dummy element or not. If it is it puts a 
in a corresponding location else puts a 0 in it. After this step, we find the OR of these 
its for each permutation independently and simultaneously. At the end of this step, we 
'ill know for each permutation whether it contains a dummy element or not. 

So, the remaining work is to bring together the non-dummy permutations (those that 
oes not contain any dummy elements). We rank each non-dummy permutation to get 
s index among the non-dummy permutations. We can rank a fc-permutation using k 
rocessors in 0(log k) time on CREW PRAM (see Section 2.2.1). We use this procedure 
) first rank the permutations (non-dummy) and put them at the position indexed by their 
ank. The ranking of all the permutations goes independently and simultaneously. This 
:ep takes a time of O(log(mzn(6,r)) = O(logn). Note that while ranking we will 
ssign processors to all permutations (not necessarily non-dummy permutations), but 
lose processors assigned to dummy-permutations keep idle. 

So, the work done is 

W = j:?” {b ' r) P(a,i).i\ogi 

To bound this sum, we consider two cases. 

Case 1: b> r: 

W = ££o (fc,r) P(a, i).i log i = ELo P{«, *)•*' *' < Ei=o P(a, *> log r = r log r. EU P(a, 0 

Consider the following special case of Vandermonde's convolution. 

PM = ELo P(a,i).C(r,i).P(b,r- i ) 

From this it follows that E;=o P ( a >*") ^ P{x,r ) 

So, W < rlog rP(x,r) 

The following lemma is useful later in the proof, 
nma 3.12 if x = [f] and r < x, then P(n,r)/P(x,r) > 2 r_1 . 
of: Consider, f ^ 

There are r terms in each of numerator and denominator. 

Ve consider two cases 

Case 1: n is even: 

x = | or 2x = n. 
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2(x — i) < n — i if 0 < i. 

It follows that b/ n,i 1 > 2 r or ^ n,r | > 2 r-1 

Case 2: n is odd: 

x = (n + l)/2 or n = 2x — 1 

So, 2(x — i) < n — i for i > 1 

Using this it follows that > 2 r_1 . 

Thus, our claim is verified. I 

Using Lemma 3.12, we have P(x,r) < P(n,r)/ 2 r ~ 1 
So, W < r log rP(x,r) < r log rP(n, r)/2 r_1 < 2 rP(n,r), 
as 2 r > logr. 

So, W is bounded by 0(P(n,r).r). 

Case 2: 6 < r: 

w = ESJo"' 1 ’'’ P(°, *)•« log * = Elo -P(o, ■)•■' log i 
< ELo P(“t i)-i log * = * log 6. ELo J°!». >) 

Consider the following special case of Vandermonde’s convolution. 

P(i, b) = ELo P(o, »)-C?(fc, i)-P(b,b- i) 

It follows that ]C{=o i*(a,0 ^ -P(®, 6) 

So, W<61og6P(x,6) 

Using Lemma 3.12, we have P(x,b) < P(n,b)/2 b ~ 1 
So, W < b\ogb.P{x,b) < blog 6P(n,6)/2 i>_1 < 26P(n,6), 
as 2 6 > log b. 

So, W < 2.rP(n, b) < 2.rP(n, r) 

The first step follows because b < r and the next step follows because b < r < n. 
Thus, it follows that the work done for getting the ^-permutations of b objects {a + 
1, a + 2 . . . ,x} is bounded by 0(P(n,r).r ) with O(logn) time complexity. 

Now that we have with us all the permutations needed for the a objects {1,2,..., a} 
and b objects {a + 1, . . . ,x}. So, the next step is to generate the needed permutations for 
x objects {1, 2, . . . ,x} by combining these permutations. But the lengths of permutations 
that we need depends upon the value of r with respect to x and y. In other words, we 
need to know which of the Eqs. (3.16), (3.17), (3.18) is applicable, then we will know the 
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range of lengths for the permutations needed for x objects. For example, if Eq. (3.17) is 
applicable, then range is r — y to r. 

So, depending on the equations’s applicability, we do the processor allocation for gen- 
erating permutations of x objects for that range using Eq. (3.19). We then generate the 
permutations for the corresponding range. The time taken is 0(log n) with work bounded 
by 0(P(n,r).r ) as we are generating only the needed permutations and depending upon 
the case we use Eqs. (3.16), (3.17), (3.18) whichever is applicable to bound the work. 

So, at the end of this step, we have generated needed permutations for x objects. 
Generation of permutations for y objects {a: + 1, x •+ 2, . . . , n} 

Now, in a similar manner, we have to generate the permutations for y objects, where 
the range of permutations length is specified by the applicability of Eqs. (3.16), (3.17), (3.18). 
For example, if Eq. (3.18) is applicable then the range is r — x to y. 

If n is even then x = y. Then obviously, the length of permutations needed from 
both the x objects and y objects is same (see Eqs. (3.16), (3.18) and Eq. (3.17) will 
not be applicable in this case). So, we simply copy all the ^-permutations of x objects 
except we add x to each element. 

On the other hand, if n is odd, then we proceed as follows. 

If n is odd, x = y + 1. Since, x = a + £>, it follows that y = a + (6 — 1). 

So, our idea is, like the earlier approach, we generate the fc-permutations of a objects 
for 1 < k < min(a, r ) and fc-permutations of b — 1 objects for 1 < k < min(b — 1, r ) 
and combine them to get the needed permutations of y objects. Note that, if b = 1, 
then this last step is not needed and the permutations from a objects itself serve as the 
permutations for y objects. 

We proceed in a similar manner to generate the needed permutations of y objects in 
O(logn) time with 0(P(n,r).r) work. 

Once we have with us the needed permutations of x objects and y objects, we use 
Eqs. (3. 16), (3. 17), (3. 18) whichever is applicable. We first allocate the processors based 
on this equation and later generate the r-permutations of n objects. The time taken is 
O(logn) (for processor allocation) and work done is 0(P(n,r).r). 

We obtain the following theorem. 

Theorem 3.13 The r-permutations ofn objects can be generated in O(logn) time with 
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I 


optimal work 0(P(n,r).r ) on CREW PRAM. 

3.4 Conclusions 

We have discussed two algorithms for generating r-permutations of n objects. Both are 
optimal and work on the CREW PRAM. While the r-recursive algorithm generates the 
permutations lexicographically, the n-recursive algorithm does not. 
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Chapter 4 

Efficient Parallel Algorithms for 
Generation of Permutations 

4.1 Introduction 

In this chapter we discuss parallel algorithms for enumerating the permutations. (For 
introductory comments refer to Chapter 3) 

This chapter is organized as follows. In Section 2, we present a cost optimal algorithm 
to generate r-permutations with time complexity 0(r). This algorithm is based on the 
concept of permutation tree. In Section 3, we present an efficient algorithm, which 
runs in O(logn) time but generates the permutations in the restricted case where we 
want to generate the n! n-permutations of n objects. In Section 4, we generalize this 
algorithm to generate all the r-permutations of n objects in O(logn) time. In Section 5, 
we indicate the connection between our improved algorithm and a restricted version of 
parallel integer sorting; any improvement in algorithm for integer sorting will result in 
corresponding improvement in our algorithm. Some conclusions are offered in Section 6. 

4.2 Basic Algorithm 

Our first algorithm to generate permutations is based on a data structure which we 
call permutation tree. A permutation tree captures the notion of generation of all the 
permutations in a succinct and simple manner. Similar tree structures are used by [7] to 
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represent the enumeration of all the possible paths in a graph, there they are called as 
logic trees ; we believe "permutation tree" is a more natural term for this data structure. 

4.2.1 Permutation Tree 

We assume that the elements of S can be ordered and we are interested in generating 
r-permutations out of n elements from S. Let 5[i] = i be the i th element of set S. 
Definition: An (n,r, S')— Perm utation Tree corresponding to the r-permutations of n objects 
present in S is a tree with following properties: 

1. If r = 1 then the root has n children and ith child is labeled with 5[i]. 

2. Ifr > 1 then the root has n labeled children such that the label of V{, the ith child, is .S'fi] 
and the ith subtree rooted at Vi is an (n — 1 , r — 1 , S — {*?[i]}) permutation tree. 

It is easy to observe that, each subtree of an (n,r, S ) permutation tree is a permuta- 
tion tree. The path from any child of root to a leaf is an r-permutation of n objects and 
we call this the permutation associated with that leaf. Permutations associated with dif- 
ferent leaves are distinct. Furthermore, the permutation tree preserves the lexicographic 
order of the permutations, in the sense that if a leaf v is to the left of another leaf 
w, then the permutation corresponding to the first leaf v lexicographically precedes the 
permutation corresponding to the leaf w. This property can be easily proven by induction 
on the number of levels of the permutation tree. 

By a path we mean the concatenation of labels associated with the nodes in order. A 
leaf p is left of a leaf q if and only if there exist nodes s, t, u such that p is a descendant 
of t, q is a descendant of u, t and u are children of s, and t occurs before u. For the 
relevant graph theory terminology refer to [14]. An example of a permutation tree for 
the case where n = 3 and r = 2 is given in Figure 1. 

4.2.2 Algorithm 

Our algorithm builds a permutation tree initially and then lists all root to leaf paths to 
generate the required permutations. The algorithm works as follows. 

The list of n positive integers S = {l,2,...,n} are stored in an array A (i.e., 
A[i] = i ) and we are interested in generating m-permutations of elements from S. The 
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Figure 1: Permutation tree when n = 3 ,r = 2 


root has n. children and we associate n — 1 processors with each child. The first processor 
in the set of processors associated with ith child copies A[i], the ith element from the 
array into the label associated with that child. In the next step, for each child v, the 
list of processors associated with node v copy all the values from the array A except the 
value stored in that child to an array associated with that node. Now, for each child, 
this algorithm is applied recursively (considering that child as the root). This recursive 
call correspond to generating (m — l)-permutations from n — 1 elements from S which 
are associated with that particular node. The algorithm terminates when m = 1 in which 
case, only the first step is sufficient and no copying of remaining elements from the array 
to a different array takes place. 

Once the tree is built, we associate a processor with each leaf and it reads the path 
to get the permutation. A number is associated with each processor which represents 
the rank of that permutation in the lexicographic order. 

The algorithm is formally given in Fig. 2; we depend upon the indentation to show 
the boundaries of statements. 

By A — A[z] we mean the array formed by removing the ith element of A. This can 
be obtained by n — 1 processors in constant time, if A contains n elements. The last 
step is a parallel recursive call. In this algorithm when B is a two dimensional array 
then, B[i], refers to the ith row of B as a whole. The fifth parameter of Gen-Perm is 
specifically provided for the purpose of processor allocation. For the call Gm-Perm(node, 
A,n,m,a), processors a to a + P(n,m) — 1 should be allocated. 
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Algorithm Generat eJPermutations (n ,m) 

Begin 

Create_node(Root) ; 
for i = 1 to n in parallel do 
A [i] = i; 

Gen-Perm (Root , A,n,m, 1) ; 

End; 

Algorithm Gen_Perm(node,A,n,m,a) 

Begin 

Create 'n' nodes, Node[l..n]; 

/* Copy label */ 

for i = a to a+n-1 in parallel do 
NodeCi-a+1] .parent = node; 

Node [i-a+l] .label =A [i-a+l]; 
if (m==l) 

/* Generate permutations */ 

Write the reversal of path from node[i] to the child of the root as 
the permutation in location 'i'. 
if (m > 1 ) then 

for i = 1 to n in parallel do 

B[i] = A - A [i] /* B[i] contains all the elements of A except its 
i-th element.*/ 
for i = 1 to n in parallel do 

Gen-Perm (Node [i] , B[i],n-1, m-1, a + (i — l)P(n — 1, m — 1)) ; 

End. 


Figure 2: Algorithm 1 
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The algorithm is building the tree level by level. As building a single level takes 
constant time, we have the following theorem. 

Theorem 4.1 All P(n, m) permutations can be generated lexicographically in 0(m) time with 
0(P(n, m )) processors on the CREW model. 

Proof: We will prove the theorem by mathematical induction. We first prove that time 
complexity is 0(m) by induction on m. When m = 1, the algorithm takes only one step. 
Let us assume the algorithm for m < k takes atmost cm time (for some constant c). 

Now consider the case where m = k + 1, In the algorithm (after taking a constant 
number of steps), there are n recursive calls. All of these execute simultaneously. Hence 
the time complexity is T(k ) + 0(1) < c\ + ck < c(k H- 1) = cm, if c\ < c. Hence our 
first claim is validated. 

We next show again by induction on m that processor complexity is 0(P(n,m)). 
For m = 1, clearly the number of processors needed are n = P(n, 1). 

Let us assume the claim is valid for m <k. 

For the case where m — k + 1, there are n recursive calls to GenJPerm and by 
induction hypothesis each of the calls needs P(n — 1 ,m — 1) processors. Hence, the 
number of processors needed are max(n, n(n — l),nP(n — l,m — 1)) = max(n, n(n — 
l),P(n,m)) — P(n,m), since P(n,m) = nP{n — l,m — 1). Hence our claim is 
validated. 

Further as there are no simultaneous writes, the algorithm can be executed on the 
CREW model. As permutation tree stores the permutations in lexicographic order, the 
theorem follows. 1 

As each m-permutation is of length m and as total number of permutations is 
0(P(n,m), for permutation generation fl(P(n,m)m) is a lower bound. The cost of 
our algorithm is 0(mP(n,m)). Hence the algorithm is cost optimal. 

4.3 Logarithmic Time Algorithm for n-permutations of n objects 

In this section we discuss a more efficient algorithm to generate permutations for a 
restricted version. We generalize this algorithm in the next section. 

The problem we are concerned in this section is formally defined as follows: 
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Algorithm Generate.permutations (n) 
Begin 


for i = 1 to n! in parallel do 

for j = 1 to n do perm[i,j] = j; 

k[i] = i— 1 ; 

m[i] = (n-1) ! ; 

for j = n-1 downto 1 do 

/* Get factorial representation */ 
a[i] = k[i] div m[i] ; 
k[i] = k[i] mod m[i] ; 
m[i] = m[i]/j; 

swap (perm [i,j+l] , permCi, j+l-a[i]] ) ; 


End. 


Figure 3: Algorithm 2 

Restricted Problem: Generate all n-permutations of n objects. 

We have to generate all the n! permutations each of length n. Our algorithm is 
based on a linear time algorithm given in [34], We reduce the time required to O(logn). 
Algorithm uses the concept of factorial representation [28] of numbers in the range 0 to 
n! — 1. 

Lemma 4.2 Any natural number k from 0 to n\ — 1 can be uniquely represented as a sequence 
(a n _i , a n _ 2 , . . . , ai) with 0 < a,- < i such that k = YZ=i a i 

In [28] there are number of algorithms which establish a correspondence between the 
above representation and generation of permutations. The algorithm of [34], given in 
Fig. 3 exploits this correspondence. 

In the above algorithm swap(perm[i,p],perm[i,q]) swaps corresponding elements of 
the two-dimensional array perm. When the algorithm terminates, perm[i] contains the 
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permutation corresponding to the integer i — 1. But unfortunately, the algorithm does 
not generate permutations in lexicographic order. 

We next give a proof of the correctness of algorithm; the original paper did not 
provide the proof. Moreover, we use some of the arguments from the proof in our 
improved algorithm. 

Theorem 4.3 Algorithm 2 correctly generates the n-permutations of n objects. 

Proof: Observe that in the algorithm the only operations that are applied on the output 
array, perm are swaps. More over, initially the numbers 1 ...n are copied into each 
array. Hence when the algorithm terminates, each array certainly contains a permutation 
of n objects. As we are generating n! permutations, to complete the proof it is sufficient 
to show that permutations that are generated are distinct. 

We use induction. Consider the case, where n = 1, the array will contain only the 
trivial permutation (1) and from the algorithm we can see that the algorithm correctly 
generates this permutation. So our basis is proved. 

By induction hypothesis let us assume that, the algorithm works correctly for the case 
when n < k. Now, consider the case when n = A;+l. We prove by contradiction. Let us 
assume (for sake of contradiction) that the permutations generated are not all distinct. 
So there must exist two integers p and q for which the algorithm generates the same 
permutation. Let us consider the factorial representations of p and q (see Lemma 4.2). 
Let us assume 

P = (•Sn— 1) $n— 25 • • • i ^l) 

9 = (^n— 1) ^n— 2) • • • ?^l)- 

Now perm[p ] is the permutation corresponding to integer p and perm[q ] is the per- 
mutation corresponding to integer q. Based on our assumption, perm[p,i] =perm[q,i\, 
1 < i < n. This implies that perm[p,n\ = perm[q,n]. In Algorithm 2, the perm\p,n] 
participates in only one swap, svjap(perm\p,n],perm\p,k 1 }) where k x = n - $„_i. Sim- 
ilarly, the corresponding swap for perm[q,n] is swap(perm[g, n],perm[q, & 2 ]) where k 2 = 
n - Moreover, this is the first swap that takes place when the swapping starts for 
each permutation; but since perm[p,n] =perm[q,n ], it implies perm\p,kj\ =perm[q, k 2 ]. 
But when first swap takes place perm[p, ki] contains k x and perm[q,k 2 ], contains k 2 , thus 
fci = k 2 , or n — s n _ i = n — t n - i and hence s n _i = t n - 1 - 
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Let p = (s n _2, • • • j-Sj) and q = (f n _ 2 , . . . ,ti). As p q, it follows that p' ^ q 1 . 
The fcith ( ki = k 2 ) position of perm[p ] and perm[q ] have value n, From Lemma 1, 
p' and q' are valid integers with respect to n — 1 permutations, thus after finding the 
permutation corresponding to p' and q' , they will be identical. But this contradicts our 
induction hypothesis. Hence our proof is complete. I 

4.3.1 Basic Idea 

Now we discuss a more efficient parallel implementation of the above algorithm. 

First, we find all the swaps that will be taking place. Then, we simulate the swaps. 
To find swaps we have to get the factorial representation of an arbitrary integer in the 
range [0..n! — 1]. For this we give a much faster algorithm (Step 1 of Algorithm 4 ). We 
do this in constant time. Finding the result of all swaps is non-trivial. Here we observe 
that after all swaps are over, each position of the array will contain some number. For 
example, suppose perm[a,2] has the value 6. What this means is that through some 
swaps, perm[a, 2 ] has got the value perm[a,6]. This might have taken more than one 
step. There can be a chain in the sense that perm[a, 4 ] might have got perm[a,6] and 
perm[a, 2] might have been interchanged with perm[a, 4 ]. So, in other words we are 
interested in knowing what is the final value that will enter into a particular location 
without actually performing all these swaps. 

We first describe some notation which will be used later. Ordered pair (p,q) when 
p < q will denote swap between perm[a,p] and perm[a,q] for an arbitrary permutation 
perm[a]. Moreover we say that q is right paired with p and p is left paired with q. 
Similarly if ( p , q) is a swap then we say p is in the left position and q is in the right position. 

Observe that each index p is right paired with exactly one index and that is /astswap 
in which index p participates. More over p may be left paired with any number of indices 
(possibly zero). But if there are two swaps (p, 04) and (p, a 2 ) with a 2 < a 2 , then the first 
swap takes place after the second swap has taken place. Further, if (p,a 2 ) is the swap 
that has taken place just before (p, ai) with p in the left position, then the final value that 
comes into position of £tj depends on the value in a 2 , when it is swapped with p. But 
this depends upon the final swap in which a 2 is in the left position. So to facilitate this 
case we maintain a linked list. For each element in the range 1 ...n there is a node. 
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A node corresponding to p points to q if and only if there is a swap ( p , q ) and it will 
be the last swap that has taken place with p in the left position in Algorithm 2. Or, in 
other words, q is the smallest of all the elements that have participated in swaps with p 
in left position. There may be a number of linked lists but the node corresponding to 
an element will be in exactly only one linked list; thus the total number of linked lists is 
atmost n, i.e, the number of nodes. 

Let us consider the case, where, (p,ai) is the swap that immediately takes place after 
the swap ( p , a 2 ) has taken place with p in the left position. As each element participates 
in only one swap in right position, it follows that, the final value that comes into the 
position ay depends upon this swap (p, a*) only. But the value that comes into ay is 
the value that has finally come into a 2 before it participated in a swap with p. If node 
corresponding to a 2 points to some node say, by, then whatever the final value that 
has come into by finally will be the element that comes into a 2 before its swap. This 
recursive structure terminates when a node, say, v' has no next node; or equivalently, 
the index corresponding to node v' , say, v, has no swap with v in the left position. So, 
v' .next — nil as there is no swap such that v is in left position. Thus with respect to 
linked lists, for each node, it is the element or value corresponding to the node which is 
the last node in that linked list, which will be the final value that enters into that node 
when it participates in its swap in right position (if any). 

Now consider possibility of swap(p,p). This happens when the digit corresponding 
to the element p in the factorial representation for that particular permutation is zero. 
What this in effect means is this is no swap at all. But we know that this is the only 
swap that takes place with p in the right position. So, if we want to know what is the 
final value that ends up in the pth position, then p will be head of a linked list and more 
over, the element corresponding to the last node in that linked list will be the element 
which will finally reside in position p. Similar is the case for the first element of the 
permutation which has no associated swap; in the factorial representation we have only 
one n - 1 digits for a number and they are (respectively) associated with indices 2 ...n 
of the permutation. As a special case, if (p, q) is the first swap with p in the left position 
then the final value that will go to position of q is p. These observations are used in 
Algorithm 3 (see Figure 4). 
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Algorithm Gen_all_perm(n) 

Begin 

for j = 0 to n!-l in parallel do 
1: for i = 1 to n-1 in parallel do 

a[j,i] - (j mod (i+1) ! )div i! ; 
b Cj , i+1] . (key , data) = (i+1 - a[j,i], i+1); 

2: sort b [ j] ) in stable manner 

/* Finding the minimums */ 

3: for i = 1 to n in parallel do 

3.1: c[j,i] .min = 0; 

3.2: Assign C[j,i].min * p, in such a way that 'p" is the minimum 

element that took part in a swap with element 'i' for the 
permutation corresponding to integer 'j 
/*In array b [j] if two adjacent 

elements are (01,02) and (61,62) and if (a x <> 6 X ) then C\j> 6 X ] = 6 2 . */ 

/* Set the linked list*/ 

3.3: if c[j,i].min != 0 then d[j,i].next * c [j , i] . min ; 

else d[j,i].next = nil; 

4 : Compress (d [j] ) ; 

5: for i := 1 to n in parallel do 

if (i==l) then perm[j,l] = d[j,l].next 

/* First element has no associated digit in factorial representation */ 
else 

if (b [j ,i] .key != b[j ,i+l] -key then 
/* b[j,i].data is the first index which 
swaps with index b[j,i].key */ 

perm [j ,b[j ,i] .data] =b[j,i].key ; 
else 

perm [j , b [j , i] . data] = d[j ,b[j ,i+l] .data] .next ; 

End. 


Figure 4: Algorithm 3 



In Algorithm 3, we want to sort b[j, 2] . . . b\j, n] for an arbitrary jth permutation; the 
first element b\j, 1] is excluded. More over, we assume the sorting algorithm to be stable. 
In Step 1 we are getting the factorial representation of a number; this step can be done 
in constant time with n processors, (provided division is part of instruction set and word 
size is sufficiently large). Step 2 involves sorting which can be done in O(logn) time 
with n processors[12]. Step 3.1 can be done in constant time As sorting in Step 2 is 
stable, Step 3.2 can be done in constant time with n processors using the information 
available in the array ‘b’ . It is easy to observe that Step 3.3 can also be done in constant 
time. So in other words Step 3 can be done in constant time with 0(n ) processors. 

In Step 4, we have a set of linked lists. There will be an associated node for each 
integer in the set S = {1,. .. , n}. More over each node appears in only one linked list. 
In other words the sum of length of all these linked lists is n. Compressing these linked 
lists means, all nodes must point to their last node in their linked list. Further if for some 
arbitrary node v if v.next = nil, then after compressing v will point to itself. This can be 
done in O(logn) time with 0(^~) processors[25]. It is easy to observe that Step 5 can 
be done in constant time with 0{n ) processors. All these steps will be done in parallel 
for n! integers in the range 0 to n! — 1. 

In Step 1 we are simultaneously using (or reading) the value of "j" for getting the 
factorial representation of the number. This step is executing in constant time with n 
processors. Suppose if we broadcast this value of j on an EREW model to all the n 
processors in O(logn) time with processors, then Step 1 will take O(logn) with 
processors on an EREW model. So, in essence as we can clearly see, all other steps can be 
made to execute on an EREW model with the same time and processor complexities (note 
that we are assuming that n is known to every processor at the beginning of execution 
itself). Hence we can execute this algorithm on an EREW model. Summarizing all these 
observations leads to the following theorem. 

Theorem 4.4 We can generate all n\ permutations of n numbers taken all at a time in 0 (log n) 
time with 0(n\n) processors on an EREW model. ® 

The processor time product of this algorithm, is 0(n!nlogn), which is not cost 
optimal. We can see that except for sorting, all the remaining steps can be done with a 
time complexity of O(logn) and with a processor complexity of 0(j^^). In the above 


73 


algorithm, we have used merge sort. to sort items which are integers in the range 1 . . .n. 
But we can use more efficient parallel integer sorting algorithms. But unfortunately, 
there is no known optimal O(logn) time parallel deterministic integer sorting algorithm 
on O(logn) bit word sized machines. If we use the Bhatt et al’s [9] parallel integer 
sorting in place of the above parallel merge sort then this leads to the following theorem. 

Theorem 4.5 We can generate all n! permutations of n numbers taken all at a time in 0(log n) 
time with 0(n log log nn!) work on the ARBITRARY CRCW PRAM. I 

We explore the relationship between parallel integer sorting and our algorithm more 
fully in Section 5. However, there are randomized [35] and non-conservative [24] al- 
gorithms for integer sorting which achieve the cost optimality. Thus we have following 
theorems: 

Theorem 4.6 We can generate all n! permutations of n numbers taken all at a time in O(log n) 
time with optimal 0(n\ processors using a randomized algorithm on EREW PRAM. I 

Theorem 4.7 We can generate all n! permutations of n numbers taken all at a time in O(log n) 
time with processors on an EREW PRAM having a word length fi(log 2 ra). I 

4.4 Logarithmic Time Algorithm 

In Section 3, we solved a restricted version of the permutation generation problem, where 
we generate all the n! permutations of n objects. In this section we consider the general 
problem of generating all the r-permutations of n objects, where r < n. 

4.4.1 Basic Idea 

Suppose we have generated all n! permutations of n distinct objects using Algorithm 3. 
Now consider suffix of length r of each of these permutations. Each of the r-permutations 
will appear exactly (tz — r)! times. Generalized algorithm is based on the observation that 
these (n — r)! permutations corresponding to each suffix will be together in the sense that 
they will correspond to the consecutive numbers (see Theorem 4.8 below). So, in other 
words the first (n — r)! permutations corresponding to numbers, i.e, 0...(n r)! 1 
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will have the same suffix and similarly the next ( n — r)! permutations will have the same 
suffix and so on. Thus, we will not generate all these (n — r)! permutations but we will 
generate only one permutation representative of each suffix. 

Observe that the last r numbers in the permutation array depend only on the part 
a n _ r . . . a n _ i of the factorial representation of numbers (see proof of Algorithm 2). This 
is because, once the swaps corresponding to these numbers are over, then previous suffix 
of length r does not change, as it does not participate in any more swaps. Hence we can 
work only with that part of the factorial representation of the numbers and dispense away 
with the remaining part; this will improve the cost of algorithm from 0(P(n,r).xnxlogn) 
to 0(P(n,r ) x r x logr). However, calculation of n! takes O(logn) time. So, if the 
value of n\ is provided as part of the input, the algorithm can be made to run with a 
time of O(logr) and with the same work as specified above. 

Theorem 4.8 In Algorithm 3 all the permutations which have the same suffix will be together 
(consecutive). 

Proof: In our proof, we use Lemma 1 of Section 3. From Lemma 1, only the prefix 
of length r of the factorial representation of a number will decide the suffix of length 
r, of permutation corresponding to that number. Hence unless that prefix changes, our 
permutation corresponding to the suffix of length r of the original permutation does not 
change. So we will be done if we are able to show that the prefix of length r changes 
only after having generated (n — r)! numbers which have the same prefix and that all 
these numbers are consecutive. 

Now from Lemma 1, any natural number k from 0 to (n-r)!-l can be uniquely rep- 
resented as a sequence (a n _ r _i, a n _ 2 , . . . , ai) with 0 < a,- < i such that k = T -1 

Let R = (6„_i . . .&i) is the factorial representation of an arbitrary number s in the 
range 0 to n! — 1. Based on our earlier observations, the prefix (6 n _! . . . £> n _ r ) decides 
the suffix of length r of the s-th n-permutation. Now, let us replace the suffix of length 
n - r — 1 of R with (a„- r -i • • ■ ai) which is the factorial representation of an arbitrary 
number k in the range 0 to (n-r)!-l. Then we have got a valid factorial representation. 
This implies that there are (n -r)! numbers which are consecutive and in which there is 
no change in their prefix of their factorial representation. This follows from Lemma 1, 
because, the numbers are unique in this representation. Hence the theorem. B 
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The algorithm is given in Figure 5. 

We can clearly see that Algorithm 4 is very similar to Algorithm 3 from which it is 
derived. Hence we do not conduct here a detailed analysis as the observations made for 
the original algorithm are applicable to this algorithm mutatis mutandis. Here the number 
of swaps for each permutation is r. This algorithm can also be implemented on a EREW 
model. Thus we have the following theorems. 

Theorem 4.9 Algorithm 4 has a time complexity of 0 (log n) and a cost of 0(P(n,r)r log r) 
and runs on a EREW model. I 

Theorem 4.10 Algorithm 4 has a time complexity of O(log n) and a cost of 0(P(n, r)r log log r) 
and runs on the ARBITRARY CRCW PRAM. I 

4.4.2 Generating permutations Lexicographically 

Algorithm 1 generated permutations in lexicographic order, but the Algorithms 3 and 4 
did not generate permutations in lexicographic order. In this section we suggest a post- 
processing method based on ranks to get permutations in lexicographic order without any 
increase in time complexity. We can calculate the rank of the permutation in O(logm) 
time with m processors on CREW PRAM (see Section 2.2.1). Using ranking, we can 
easily show that 

Theorem 4.11 The m-permutations of n distinct objects can be generated in lexicographic 
order in 0(log n) time with 0(P(n, m)m log m) work on the CREW model. 

Theorem 4.12 The m-permutations of n distinct objects can be generated in lexicographic 
order in O(log n) time with 0(P{n, m)m 2 ) work on the EREW model. 

4.5 Relationship between generation of permutations and paral- 
lel integer sorting 

There is a relationship between our algorithm to generate permutations and a restricted 
version of parallel integer sorting. Consider restricted versions of parallel integer sorting. 
Restricted Problem 1 : Sort n integers in given in array A where the following property 
holds. A[i] < i and the integers are in the range 1 . . . n. 
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Algorithm Gen_perm(n,r) 

Begin 

for j * 0 to n!-l step (n-r) ! in parallel do 
1: for i = n-r to n-1 in parallel do 

a[j,i] = (j mod (i+1) ! )div i! ; 
b[j , i+1] . (key, data) = (i+1 - a[j,i], i+1); 
2: sort b[j] Stably; 

/* Finding minimums */ 

3: for i = n-r to n in parallel do 

3.1: c [j , i] . min = 0 ; 


3.2: Assign C[j,i].min = p, in such a way that 'p' is the minimum 

element that took part in a swap with element 'i' for the 
permutation corresponding to integer 'j'. Use array b[j] 

/* Set the linked list */ 

3.3: if c[j,i].min != 0 then 

d[j,i].next = c[j,i].min; 
else 

d[j,i].next = nil; 

4: Compress (d [j] ) ; 

5: for i := n-r to n in parallel do 

if (b[j,i].key != b[j,i+l].key then 

/* b[j,i].data is first index which swaps with index b[i,j] .key */ 
perm [j ,b[j ,i] .data] = b[j,i].key; 
else 

perm [j ,b[j ,i] .data] = d[j ,b[j , i+1] .data] .next ; 

End. 


Figure 5: Algorithm 4 
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The next restricted problem removes one part of the above restriction and is formally 
defined below. 

Restricted Problem 2 : Sort n integers in the range 1 . . . n. 

We first show that Restricted Problem 2 is reducible to Restricted Problem 1. More 
specifically if there exist an O(logn) time optimal algorithm for the Restricted Problem 1 
then there is an algorithm with the same bounds for Restricted Problem 2. 

Let us assume that we have to sort n integers in the range 1 . . . n given in an array 
A. Copy A[1 . . . n] + 1 to B[n + 1 . . . 2 n] and assign l’s to B[ 1 . . . n]. Now in array B 
all elements are in the range 1...2n and B[i\ < i for each i. If there is an O(logn) 
optimal algorithm for Restricted Problem 1, then we can sort items of array B using 
this algorithm; all extra elements will be at one end and can be removed by shifting 
remaining items n places to left. Later we subtract 1 from the remaining elements to 
restore the elements. This post processing can be done in constant time. Thus we have 
got an optimal algorithm for less Restricted Problem 2. 

We next show that a relationship exists between parallel integer sorting and our 
algorithm to generate permutations. Note that in algorithm 2, a permutation is being 
found for each integer in range 0 to nl — 1. Hence this can be considered as an Unranking 
procedure. 

Theorem 4.13 If the unranking procedure of Algorithm 2 can be implemented in O(logn) 
time with 0(n) work then we can solve the Restricted Problem 1 of parallel integer sorting in time 
0(log n) in an optimal manner. 

Proof: We are generating a permutation corresponding to an integer in a particular range 
in Algorithm 2. Let us assume it produces a permutation corresponding to a number in 
time O(logn) and with a processor complexity of 0(n/logn,). 

Given a parallel integer sorting problem with the restriction A[i] < i we construct an 
integer which is given to the algorithm for the production of corresponding permutation. 
We later do post processing to get our sorted list. We first indicate the preprocessing 
needed. 

for i =1 to n in parallel do 
B[i-1] = i - A[i] ; 
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C [i] = i ; 

pref ix_mult(C) ; 

for i =1 to n-1 in parallel do 
D[i] = B[i]*C[i] ; 

P = sum(D) ; 

In the above pre-processing we are constructing an integer whose permutation we 
will later generate. In the generation of permutation, there will be a swap corresponding 
to each element except the first element. For each i, we intend that there should be a 
swap of ith element with A[i ] th element. This information is encoded in the factorial 
representation of an integer. So, in the pre-processing step we first obtain the factorial 
representation (stored in array B) and later obtained the corresponding integer P. 

It is easy to observe that the for loop can be implemented in 0(1) time with 0(n) 
processors or O(logn) time with 0(n/ log n) processors. After prefix product com- 
putation, C[i] = i\\ all products can be computed in O(logn) time with 0(n/ log n) 
processors[25]. 

Now we create another array D as follows: D\i\ = B[i] * C]i\ . We then sum all the 
elements of array D into P. This gives us the required number. It is easy to observe 
that pre-processing can be accomplished in time O(logn) with 0(n/ log n) processors. 
We give number P as input to the permutation generation algorithm. 

Let us assume that the permutation generator works optimally and then generates 
the permutation corresponding this integer in O(logn) time. We will apply the following 
post processing to extract the sorted list from the permutation. 

1 for i = 1 to n in parallel do 

E[i] = 0; 

1.1 write i into E[A[i]] . 

1.2 if E[i] != 0 then 

F[E[i]] .next = i; 

2 compress (F) ; 

3 for i = 1 to n in parallel do 
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// Start of each linked list 
if E[i] != 0 then 

Start [i] .next = E[i] ; 

if perm[i] == b and A[i] == b then G[i] .next = NIL; 
else G[i] .next = F[perm[i]] .next; 


Here we use a CRCW priority model in which in the case of simultaneous writes the 
lowest numbered processor succeeds. Here A is the array which has the list to be sorted. 

From Stepl.l we can see that, if E[i ] = ‘c then V is the smallest element that that 
has participated with 'i' in swap. In Step 1.2 we form linked lists. In Step 2 we compress 
these linked lists. In Step 3 we form a set of linked lists for each z, 0 < i < n; these are 
the elements which are swapped with i or in other words, these are the elements which 
have the value V as their key. We have a linked list associated with each index i of the 
list. If we put all these together and rank the linked list[25] them then we obtain the 
sorted list. 

If we analyze the time needed for post processing, we can see that the time needed 
is essentially O(logra) with 0(n/logn) processors. As we have already seen the prepro- 
cessing also takes the same time and with same processor complexity. Hence the theorem 
follows. I 

4.6 Conclusions 

Existence of an optimal algorithm for our unranking procedure in permutation generation 
with time of O(logn) and 0[n ) work will result in an optimal algorithm for a restricted 
case of parallel integer sorting and vice versa. 
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Chapter 5 

Making Permutation Generation 
Optimal 


In this chapter we discuss an approach to make a particular class of permutation gen- 
eration algorithms optimal. For those permutation generation algorithms which do not 
belong to this class, even though the modified algorithm may not be optimal, it may 
possibly take less work. 

5.1 Algorithm 

Let us assume we are given a permutation generation algorithm A, which generates all 
the r-permutations of n objects with W(n,r) work and T(n,r) time. Using the approach 
suggested here, we obtain a better algorithm with less cost. The resulting algorithm may 
also be optimal in certain cases. 

Using the algorithm A, we generate all P(n — l,r — 1) r - 1-permutations of n — 1 
objects {1,2,. . . ,n — 1} in T(n-l,r — l) time with W{n- l,r — 1) work. Using these 
r — 1-permutations we obtain the r-permutations of n objects {1,2,..., n}. 

We proceed as follows. We assume that n and r values are known to every processor 
at the start. First the processors find the value of P{n — 1 , r — 1) in O(logr) time and 
by making sufficient copies every processor knows the value of P(n — l,r — 1). We 
make n copies of the already obtained r - 1-permutations on EREW PRAM. A value 
can be copied n times in O(logn) time with O(n) work on EREW PRAM[25]. Hence 
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this copying takes a time of O(logn) with 0{nP[n — l,r — 1)) work. In r-permutations 
of n objects, given the first element as i, the suffixes are the r — 1-permutations of n — 1 
objects S' = {1, 2, . . . , n} — {i}. Each value of i, (for all 1 < i < n,) can act as a prefix 
for r-permutations. So, we attach these prefixes to already obtained r — 1-permutations 
to form r-permutations. We need r — 1-permutations of S' for different values of i. We 
show below how to obtain the r - 1-permutations of n-1 objects {1, 2, . . . , n} - {i} for 
an arbitrary i. Consider each element of the given r — 1-permutations of n — 1 objects 
{1, 2, . . . , n — 1}. If that element is less than i, keep it as it is. If that element is greater 
than or equal to i then add 1 to it and replace the old value with this new value. We get 
r — 1-permutations of S'. 

Using this method, we can obtain all the r — 1-permutations of n — 1 objects 
{1,2, . . . ,n}— {i} for each i. This can be done in constant time with 0(nP(n— l,r— 1)) 
work on EREW PRAM. Note that there are no concurrent reads as for each i, we work 
on the ith copy of r — 1-permutations of n — 1 objects. 

We copy r — 1-permutations of n — 1 objects {1,2, ...,n} — {i} into locations 
(i — l)P(n — 1, r — 1) + 1 to iP{n — 1, r — 1) prefixing each r — 1-permutation with i. 
This we do independently and simultaneously for each i in constant time with 0(rnP(n— 
1 , r — 1)) = 0(rP(n,r )) work. Hence we have obtained all the r-permutations of n 
objects {1,2,. . . ,n}. 

We get the following theorem: 

Theorem 5.1 Given an 0(T(n,r)) time, 0{W(n,r )) work algorithm for generating r- 
permutations ofn objects, the modified algorithms runs in a time ofO(T(n - 1, r - 1) + 
logn) time with 0(W(n — l,r — 1) + rP(n,r )) work on the same model on which the 
original algorithm runs. 

Clearly, if the original algorithm generates the permutations in lexicographic order, 
the modified algorithm also generates the permutations in lexicographic order. If our 
given permutation generation algorithm is such that W(n — 1, r — 1) is of the order of 
0(P(n,r)r) then the resultant algorithm based on above theorem will be optimal. The 
above theorem can be put in a much more broader perspective. If the given permutation 
generation algorithm is such that its work W(n — k,r — k ) is 0(P(n,r)r) for some 
constant k, then also we can make it optimal. The approach is similar. We repeat the 
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method outlined above k times. That is, we first generate the r — fc-permutations of 
n — k objects and using them in k steps, we obtain the r-permutations of n objects, 
repeating the above method k times. 

in our algorithm as given above, we use EREW PRAM. If we use CREW PRAM 
instead, then we would have avoided the initial copying step (which copies each r — 1- 
permutation n times) and we get the following theorem. 

Theorem 5.2 Given an 0(T(n,r )) time 0(W(n,r )) work algorithm for generating r- 
permutations of n objects, on any model at least as strong as CREW, the modified 
algorithms runs in 0(T(n — 1, r — 1) + log r ) time with 0(W(n — 1, r — 1) + rP(n, r)) 
work on the same model. 

Using algorithm as specified in Chapter 4 (see Theorem 4.12) we get the following 
result: 

Theorem 5.3 The r-permutations of n objects can be generated lexicographically in 
O(logn) time with optimal 0(rP(n,r )) work on EREW PRAM. 
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Chapter 6 


Faster Optimal Algorithms for 
Generation of Derangements 

6.1 Introduction 

A derangement of set of n integers { 1 , 2 , , n} is defined as a permutation P of these 
integers which changes every element so that no integer appears in its natural position, 
ormally, if P is the ordered n-tuple {p x p 2 ...p n ) then P is a derangement of {1, 2, . . . , n} 
rovided that 7 ^ i for all i, 1 ^ z ^ n. The number of derangements of n objects is 
enoted by D(n). D(n ) satisfies the recurrence relation 

D(n) = (n - l)(D(n - 1 ) + D(n - 2 )) ( 6 . 1 ) 

ith D( 0 ) = 1 and £>( 1 ) = 0. 

For example, there are nine derangements for n = 4, namely 
2143 2341 2413 3142 3412 3421 4123 4312 4321 

Let x = (xix 2 ...x n ) and y = (j/ij/ 2 • • • y n ) be two derangements. We say that x 
'■ecedesy in lexicographic order 'd there exists an integer i, 1 < i < n, such that Xj = yj 
r all j < i and z,- < z/,-. Each derangement has an associated index in lexicographic 
der. By ranking we mean getting this index for an arbitrary derangement. Unranking 
the inverse operation of ranking; unranking finds the combinatorial object given its 
fex in lexicographic order. 



6.1.1 History and Related Work 

A number of sequential[l, 36] and parallel[23] algorithms exist for generation of derange- 
ments. The best known parallel algorithm for generating derangements runs with a time 
complexity of O(nlogn) with D(n) processors[23]. This algorithm is not cost optimal 
as generation of derangements has a lower bound of 0(nD(n)') as we have to generate 
D{n) derangements each of length n and the sequential algorithm in [ 1 ] takes 0(nD(n )) 
time. 

6.1.2 Preliminaries 

We present some of the mathematical concepts that will be used later in the presentation. 

The closed form formula for D(n) based on Eq. (6.1) is given below. 

D(„) = n![l-i + !-...+ fciH] (6.2) 

It is not difficult to show that [30] D(n ) « e~ l n\ where the approximation is quite 
accurate even for small values of n = 4. We can even show that 

D{n ) = @(n!) (6.3) 

Note that in a derangement (pip 2 ...p n ) of n elements, for each position i, i 7 ^ pi, 
for 1 < i < n. That is, every position is restricted. A partial derangement of n 
elements, with k free elements is a generalization where k of the elements are without 
restriction. In other words, k (specific) non-restricted elements can be placed in any of 
the n positions and each of the remaining ( n — k ) elements can be placed in any position, 
other than a restricted position. 

We can also define partial derangements as follows. Suppose we have set S consisting 
of n elements out of which the values of n-k elements are in the range [l..n] and the 
values of the remaining k elements are not in this range. A partial derangement is a 
permutation P =■ {jpiPi ■■■p n ) of these n elements of the set S such that p t - ^ i for 
1 < i < n . We denote by D(n,k) the number of partial derangements with k free 
elements. 

D(n,k ) satisfies the following relation[23]: 

D(n, k) = D(n, k — 1) + D{n — 1, k — 1) (6-4) 
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Based on this recurrence relation, we can obtain the following expression for D(n,k) 

k 

D(n,k) = J2C{k,i)D(n-i) (6.5) 

t=0 

where C(k,i ) is the binomial coefficient. 

6.1.3 Notation 

We define our notation which will be used in the remaining part of the chapter. Rank(D) 
denotes the rank of derangement D. Suppose A and B are derangements, A -< B iff A 
lexicographically precedes B. By \C\, we mean the cardinality of a set C. D[i..j ] denotes 
the sub-array with indices from i to j. We say k is in the range [i..j] iff i < k < j. 

6.1.4 Organization of the Chapter 

We discuss the 0(n ) time algorithm in Section 2. We present the ranking function in 
Section 3. We discuss various implementations of ranking function in Section 4. Section 
5 contains the method to obtain derangements given the permutations. 

6.2 The 0(n) Time Algorithm 

Our first algorithm to generate derangements is based on a data structure which we 
call Derangement Tree. A derangement tree is similar to the permutation tree (see 
Subsection 4.2.1). Like a permutation tree which captures the notion of permutations 
in the form of a tree a derangement tree does the same for derangements. All the 
derangements are represented in a succinct and simple manner' as the paths in a tree. 

6.2.1 Algorithmic Interpretation 

We indicate the mathematical basis for the derangement tree which we are going to 
describe and the algorithm which is based on the concept of derangement tree. 

Recall that derangements are related by the recurrence relation given below. 

D{n) = (n - l)(D(n - 1) + D(n - 2)) 

The combinatorial interpretation associated with the derivation of this identity provides 
a basis through which we have designed the derangement tree. 
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We are interested in number of derangements with n objects {1, 2, . . . , n} such that 
we place them in n places. The important restriction is that the z-th position should not 
contain the z-th object z. We formally express this in a more general form as location i 
is matched to value z. So, when a location is matched to a particular value, the meaning 
is that location is forbidden to contain the indicated value. Suppose we are interested in 
generating the derangements of n objects, not necessarily integers in the range 1 . ..n, 
then this notation provides a basis to design our algorithm. We associate each object 
with a location and generate derangements. 

Let us find the number of derangements for n objects - where initially location i is 
matched to value i. Obviously the position 1 can have n — 1 possibilities to fill it. More 
specifically, any i, i ^ 1, can come into location 1. Now, let us count for an arbitrary i 
(z ^ 1), the number of derangements with i in first position. Note that 1 can be placed 
in any position as its restricted location 1 is already filled. We delineate our calculation 
into two parts. We will first find the number of derangements in which value 1 occupies 
location z and then find the number of derangements in which value 1 does not occupy 
location z. 

In the first case, since value 1 occupies location z, the position of value 1 is fixed and 
the remaining n — 2 locations can be filled in D(n — 2) ways. 

In the second case, value 1 is forbidden to use location z. Note that since value i is 
already placed in location 1, location z has got its new matching with value 1 as 1 can 
not be in location z in this case; In this situation, we have D(n — 1) derangements. 

As the number of items are n - 1 for z, the identity follows. 

6.2.2 Derangement Tree 

We are generating all the derangements of S = {1,2,. .. , n}. We use the tree structure 
to get the inherent parallelism and reflect the recursiveness in the interpretation. 

We assume that Si [i] = 5 2 [z] = z for 1 < z < n. These arrays are used to represent 
the fact that location Si[i] is matched to value S 2 [i] for arbitrary z. 

We use remove(S, {z, j}) to denote the array obtained by eliminating the zth and 
jth indexed elements of S and append(S,a) to denote the extended array obtained by 
appending the value a to the array S. 
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Definition . An (n. Si, S2)-Derangement Tree corresponding to the derangements of n 
objects present in Si with indices specified by S\ is a tree with the following properties: 

1. If n = 1 then the root has no children and effectively the tree is empty as there 
are no derangements. 

2. If n = 2 then the root has 1 child whose label is [( 5 1 [ 1 ], 5 2 [ 2 ]),( 5 i[ 2 ], 5 2 [ 1 ])]. 

3 . If n - 3 then the root has 2 labeled children such that the label of v it the z-th 
child is (Si[l],S 2 [i + 1]) and the i-th subtree rooted at v, is an (n — l^S'^S^)- 
Derangement Tree, where S[ = a j ppenc?(remoue(6' 1 ,{l,i -f l}),Si[i + 1]) and 
S 2 = append(remove(S2,{l,i + 1}),S 2 [1]). 

4 . If n > 3 then the root has 2 (n - 1) labeled children such that the label of 

the 2 i — 1-th child is (Si[l],S 2 [t + 1]) and the 2 i — 1-th subtree rooted at u 2 ,_i 
is an (n — 1, S' v ^"Derangement Tree, where S[ = append(remove(Si,{l,i + 
1}), + 1]) and S 2 = append(remove(S2,{l,i + 1}), ^[1]); the label of u 2t - 

is [( 5 i[l], 5 2 [i + 1]), (Si[i + 1 ), 5 2 [ 1])3 and the 2i-th subtree rooted at u 2t - is an 
(n - 2 ,S' 3 ,S' a ) -Derangement Tree, where S ' 3 = remove(Si, {l,z + 1}) and ^4 = 
remove^Si, i + 1})- 

It is easy to observe that each subtree of an (n, Sj^j-Derangement tree is a de- 
rangement tree. The path (concatenation of labels associated with nodes) from any child 
of root to a leaf gives the necessary information to form a derangement of n objects. 
In the derangement tree a combinatorial object is associated with each leaf - the con- 
catenation of the labels associated with the nodes in the path from root to the given 
leaf. The label (p, q ) denotes that the value q should be stored in location p. In other 
words, each pair specifies the information needed to fill one position of derangement. 
Note that in some nodes, label contains two pairs, giving the necessary information to 
fill two positions. 

The derangement tree for n = 4 is shown in Fig. 1 . In the above figure, the arrays 
S lt S2 for each node are specified in a rectangle. The first row specifies the array Si 
and the next row specifies the array S 2 . More over, the label associated with each node 
is shown inside the node. The notation p : q denotes value q should be put in position 
p. This information has been shown for only few nodes for simplicity. 
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Figure 1: Derangement tree for n =4- 


6.2.3 Algorithm 

Our derangement generation algorithm is based on the above definition of derangement 
tree. It builds a derangement tree initially and then lists all the root to leaf paths to 
generate all the derangements. The algorithm is formally shown below. 

Algorithm Generate_Derangements(n) 

Begin 

Calculate the values of D(i) for 0 < i < n 
for i = 1 to n in parallel do 

Si[i] = i ; S 3 [t\ = i 

Create-node(Root) ; 

Gen_Der(Root , n, Si, S2, l) 

End 

Algorithm Gen_Der(Node, n, Si, S2, a.) 

Begin 
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if n = 1 then return NULL' 
else if n = 2 then 


Create node n; 
n. parent = Node; 

n. label = CCS'ifl], 5 a [2]), ($[2], S 2 [l])] ; 
else if n = 3 then 

Create nodes ni , n 2 ; 
for i = 1 to 2 in parallel do 
n,-. parent = Node; 
n,-. label = (S^l], 5 a [* + l]) 
sil = append (remove (5i, {l, i+l}) , £i[i + l]); 
si2 = append (remove (£ 2 , {l, i+l}), S 2 [l]); 

Gen_Der(n t -, n-1, sil, si2, a+(i-l)D(n-l)) ; 

else 

Create 2(n-l) nodes n[l. .2(n-l)] ; 
for i = 1 to (n-1) in parallel do 
n 2l -_i . parent = Node; 
n 2i _i. label = (Si[l], S 2 [i + 1]); 
s2i-l.l = append (remove (Si , {l,i+l}), Si[i 4- lj) ; 
s2i-1.2 = append (remove (£ 2 , {l,i+l}), £ 2 [1]); 

n 2t -. parent = Node; 

n 2 ,-. label = E(Si[l]> -S^ + l]), (Si[t + 1], £ 2 [1])3; 
s2i.l = remove(Si, {l,i+l}) 
s2i.2 = remove(S' 2 , {i,i+l}) 
for i = 1 to 2(n-l) in parallel do 
if i is even then 

Gen_Der(n,-, n-2, si.l, si. 2, a -f — 1) + D(n — 2)) + D{n — 1)) 

else 

Gen_Der(n,- , n-1, si.l, si. 2, a + [i/2\.(D[n - 1) + D(n — 2))) 

if n <2 then 
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A processor is associated with each leaf and it stores 

the derangement associated with it in the index associated with it. 

End 


We are interested in generating the derangements of elements from S = {1, 2, . . . , n}. 
The algorithm is recursive. The base cases when n = 1, 2, 3 are explained in the algorithm 
and are straight forward. 

Now, we consider the case when n > 3. The root has 2 (n - 1) children and out of 
which n — 1 children corresponds to recursive calls for derangements of n — 1 objects 
and the remaining for derangements of n — 2 objects. 

We allocate n — 2 processors with each of the child corresponding to derangements 
of n — 1 objects (the odd numbered nodes) and we allocate n — 3 processors with even 
nodes. First in each case, one among the processors allocated for each child copies the 
label from Si, S 2 as specified in the definition. In the next two steps, all the processors 
associated with each child form Si, S 2 to execute the recursive call associated with each 
child. 

The last but one step in the above algorithm is a parallel recursive call. The fifth 
parameter in the recursive call is specifically provided for taking care of the processor 
allocation. We try to identify what are the processors that are allocated to each procedure 
call. The above parallel recursion can be implemented by a model proposed in [9]. 

Let us consider the procedure call GenJDer(Node, n, Si,S 2 , a); here we are inter- 
ested in generating the derangements of n objects where the matching is specified by the 
arrays Si, S 2 . More over the processors a to a + D(n) — 1 should be allocated for this 
procedure call . The last parameter specifies that the leafs for this procedure call will 
store their associated derangements in the locations a to a + Din ) — 1. 

The algorithm is building the tree level by level. Building a single level takes constant 
time. In other words, we have the following theorem. 

Theorem 6.1 All D(n ) derangements can be generated in 0(n ) time with 0(D(n )) 
processors on the CREW PRAM. 

Proof: We will prove the theorem by mathematical induction on n. We first prove that 
the time complexity is 0(n). 
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When n — 2, the algorithm takes only one step. If n = 3 then the algorithm takes two 
steps. Let us assume the algorithm for n < k takes at most cn time for some constant 
c. 

Now, we consider the case when n = k + 1. From the algorithm, we can see that 
after taking a constant number of steps, there are 2 (n - 1) recursive calls. All of these 
execute simultaneously. Note that half of the recursive calls correspond to the case where 
n = k — 1 and the other half to n = k. Hence the time complexity is, by using induction 
hypothesis, T(k) + 0( 1) < c x +max(cA;, c(k- 1)) = q+dc < c(&+l) = cn, if c x < c. 
Hence our first claim is validated. 

We next show again by induction that the number of processors needed are D[n). 
For n = 2, or 3, this is obvious. Let us assume the claim is valid for n <k. 

For the case where n = k + 1, there are 2 (n — 1) recursive calls to GenJDer and by 
induction hypothesis, z-th recursive call takes D(n — 1) processors (D(n— 2) processors) 
if i is odd (even). Hence the number of processors needed for the recursive calls are 
(n - 1 ){D(n - 1) + D(n - 2) = D{n). 

Further, we need n — 2 (n — 3) processors for the z-th call if i is odd (even). So, 
the number of processors needed, by induction hypothesis, are max((n — l)(D(n - 1) + 
D(n — 2), (n — l)(n — 2 -f n — 3)). 

Since, D(n ) > n — 1 for n > 2, it follows that, we need D(n) processors for our 
recursive call, verifying our other claim also. 

Note that in our algorithm, there are simultaneous reads (reading the arrays Si,S 2 , for 
example) but no simultaneous writes and so we can implement the algorithm on CREW 
PRAM. i 

Recall that derangement generation has a lower bound of 0(nD(n)). Hence our 
algorithm is cost optimal. 

6.3 Ranking 

Let D = (did 2 ...d n ) be a derangement of n objects. The problem of ranking D is to 
find the index of D among all the derangements of n objects in lexicographic order. 

We proceed as follows. We find the total number of derangements which lexico- 
graphically precedes D. Suppose it is r. Then Rank(D) is r + 1. We denote by C, the 
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set of all derangements which lexicographically precede D. So, obviously 


Rank(D) = \C\ + 1 (6.6) 

We express C as a union of some smaller sets. Suppose a derangement A — 
(aia 2 . - . a n ) -< D then there exists an i such that 1 < i < n and a,j = dj for j < i and 
a,- < d{. Note that, the existence of the i in the above definition is unique. There are n 
possible values for i varying from 1 to n. We put together all the derangements which 
lexicographically precede D for the same i in a set denoted C(i). So, we will have n 
sets. Formally, 

Definition: C(i ) = {A = ( a ja 2 . . . a n )\A is a derangement, a ; - = djij < i and a t - < d{ 

} 

It is not difficult to prove the following lemmas based on the above definition. 
Lemma 6.2 C = Ui=i C(i) 

Lemma 6.3 C(i) fl C(j) = 0 ifi ^ j 

From the above two lemmas and Eq. (6.6), the following theorem follows 

Theorem 6.4 

Rank{D) = l + E|C(i)| (6-7) 

i=i 

So, our aim is to find the value of the expression |C7(*)| . We try to find the value 
|C(i)| for an arbitrary i, 1 < i < n. The calculation can be repeated for all applicable 
values of i to get fhe respective values of |C'(i)|. 

By finding the value of |C'(*)|, we mean finding the number of derangements A = 

(a!a 2 ...a n ) which have the prefix 0 but a i < d i- Note that the value s 

we can use as a,- will be coming from the set of elements contained in D[i + l..n], 
i.e, S = {di+i,di +2 ,- > d n}- Suppose we have selected an element a,- 6 S such that 

a t - < di. Thus, we have fixed first i positions of A. We have to fill positions * + 1 to n. 
Obviously these positions will be filled with elements of the set S' = S - {a ; } + {di} . Let 
us denote by the number of elements in the set S' which are not in range [i + l..nj. 
The number of ways such that we can put the elements of set S' in the positions i + 1 


93 



to n of A such that aj # j, where i + 1 < j < n is D{n - i,^) - the number of 
partial derangements of n-i elements with t* free elements. We can repeat the above 
procedure for each a,- of S . Instead, we classify those elements from S that can come 
as A, into two groups. The detailed algorithm is given below. 

The ranking function has the following steps. 

We denote by S the set of elements in D[i + l..n], 

1. Calculate k\, the number of x t -’s, x,- € S such that x t - < di and x t - ^ i and it is in 
range [i + l..n]. 

2. Calculate k 2 , the number of x,-'s, x,- £ S such that x,- < di and x,- ^ i and not in 
range [i + l..n]. 

3. Calculate k 3 , the number of x,’s, x,- € S such that x,- is not in range [i + l..n]. 

Using the values of A: l5 A; 2 and k 3 , we obtain the following expression for |C(i)|: 

JC'(z) | = ki.D(n — i, k 3 + [not((i + 1) < di < ra)]) + k 2 .D(n — i, k 3 — [i + 1 < di < u]) 

(6.8) 

where, the Iverson’s notation [P] is defined as 1 if the predicate P is true and 0 
otherwise. 

So, we can use the above general procedure for each i, 1 < i < n, to find the values 
of |C(i)| and use Eq. (6.7) to obtain the rank of derangement D. 

Our ranking function is designed in such a way that it is more general than just 
needed for ranking a derangement. More precisely, it can be directly used for ranking 
any partial derangement. Though we are not exploiting this capability of our ranking 
function in the present chapter, it is expected that such a general nature of ranking can 
have applications in other situations. 

6.4 Implementation of Ranking function 

The ranking function given above works quite well if we intend to implement the ranking 
on a serial computer. But our intention is to implement the ranking in parallel. Note 
that in a parallel model, we assume in what follows that the value n is available to each 
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processor at the start. We show the implementation of ranking on EREW and CREW 
PRAMs. Both of them assume that the pre-processing given below has taken place before 
their invocation. We first describe the pre-processing steps. 

6.4.1 Pre-Processing 

The pre-processing involves calculation of (a) i!, (b) D(i) for 0 < i < n and (c) C(i,j), 
(d) D(i,j ) for 0 < i,j < n. 

To calculate z! for 0 < i < n, we fill the array E such that £[i] = i (except E[0] = 1) 
and apply prefix multiplication on it. Then, E[i] = i\ for 0 < i < n. Then, we copy 
each s'!, n times so that there will not be any read conflict while calculating binomial 
coefficients. This can be done in O(logn) time with 0[n 2 ) work. 

Note that a single value can be copied to p locations in O(logp) time with 0(p ) 
work on EREW PRAM[25]. Similarly, prefix sum or prefix multiplication or just sum of 
n values can be accomplished in O(logra) time [25] with 0(n ) work on EREW PRAM. 

We use the following well known formula for finding the value of binomial coefficients 
C(i,j ) for 0 < i, j < n and can be done in constant time with n 2 processors. 

(6 - 9) 

with C(i, j) = 0 if i < j. 

After this, we copy each n times to avoid read conflict while finding D(iJ)'s. 

The copying can be done in O(logn) time with 0(n 3 ) work. 

Then we use Eq. (6.2) to find the values of D(i), for 0 < i < n. This can be 
done in O(logn) time with n processors. The main task involved is a prefix summation. 
We copy each D(i), n 2 times to avoid read conflict while finding D(i,j)'s, which takes 
O(logn) time with 0(n 3 ) work. 

Later, we use Eq. (6.5) to calculate D(i,j), for 0 < i,j < n, in O(logn) time with 
0(n 3 ) work. 

Lemma 6.5 Pre-processing can be done in 0 ( log n) time with 0(n 3 ) work on EREW PRAM. 
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6.4.2 The EREW Implementation 

We can find the values of k^k 2 and k 3 for each |C(*)| as specified in Algorithm (see 
Section 6.3). 

We would like to rank the derangement D = {d x d 2 ...d n ). We find the values of 
10(01 f° r each i, 1 < i < n. We will calculate all these independently and simultaneously 
in parallel. But to calculate |C(i)|, we will access the locations from i to n of D. On a 
CREW PRAM this creates no problem, but a read conflict will arise in the case of EREW 
PRAM. 

To avoid the read conflict, we ensure that each calculation of |C , (*)| proceeds on its 
own copy of D. We get n copies of D by copying each d it n times in O(logn) time [25] 
with 0(n 2 ) work. 

The calculation of |C(i)|, we describe below should be repeated simultaneously and 
independently for each i, 1 < i < n on their own copy of D. 

First the processors allocated for the calculation of |(7(i)| broadcast the value di, n 
times so that read conflicts are avoided in the calculation of k^k 2 and k 3 (see Section 
6.3). We describe below a general approach to calculate any of k\,k 2 and fc 3 . 

Assign n processors to the i-th copy of array D such that j- th processor is assigned 
to location j of array D. The processors assigned to locations D[l..i — 1] write 0 into an 
array L in their corresponding locations. Other processors look at the value contained 
in their location of array D and test a boolean condition (this varies depending upon 
whether we are finding k u k 2 or k 3 ) and write 1 or 0 into corresponding location of array 
L. Then we sum all the values in the array L in O(logrc) time with 0[n) work which 
gives the value of k 1: k 2 or k 3 depending upon the boolean condition used. 

Once we obtained k\.k 2 and k 3 , we use Eq. (6.8) to calculate the value of |C7(i)|. 

After we have obtained the value of |C'(z)| for each i, we use Eq. (6.7) to get the 
value of Rank(D) in O(logn) time with 0(n) work. 

Theorem 6.6 The rank of a derangement can be found in time O(logn) with 0{n 2 ) work on 
EREW PRAM if the pre-processing is already assumed to have taken place. 

On the other hand, if we do not consider the pre-processing separately then, 
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Theorem 6.7 The rank of a derangement can be found in time 0 (log n) with O(n^) work on 
EREW PRAM. 

6.4.3 The CREW Implementation 

After pre-processing has been done, the calculation of k lt k 2 and k 3 for each |C(i)| 
remains (see Section 6.3). Unlike the EREW model in which we independently worked 
for the calculation of each |C(i)|, the approach here is different. We will form arrays 
Ki,K 2 , such that Ki[i] gives the value of k\ for |C(i)| and so on. Recall that we are 
ranking the derangement D = (d x d 2 .. . d n ). Here D[i] is d,-. We proceed as follows for 
forming the array K 3 . 

For each i, we initially calculate how many elements of D[i..n] are in the range [i..n] 
as M[i\. Then, the number of elements which are not in this range, i.e, K 3 [i — 1] = 
n — i + 1 — M\i). 

Formally, (we depend upon the indentation to show the boundaries of statements.), 
Assume that arrays Mi and M 2 are initialized with zeroes. 

for i = 1 to n in parallel do 
if i < D[i] < n then M\[i] = 1 
else M 2 [D[i}} = 1; 

M\i] = M 1 \i] + M 2 [i\; 

Suffix-Sum (M) i 

for i = 2 to n in parallel do K 3 [i — 1] = n — i + 1 — M[i] ; 

In the above algorithm, for arbitrary j, if j < D[j] < n, then D[j] contributes 1 
to each of the M[t ] for 1 < t < j. Otherwise, D[j] contributes 1 to each of M[t] for 
1 <t< D[j]. 

Clearly algorithm correctly finds K 3 [i] for each i. 

We next look at the problem of forming of arrays Ki and K 2 . For the calculation 
of Jfcj's and k 2 's we use Generalized Prefix Computation (see Section 2.1) Generalized 
prefix computation can be done in O(log n) time with n processors on CREW PRAM[39]. 
Before proceeding further, we would like to know where each element is occurring in D. 
for i — 1 to n in parallel do = *1 
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The integer i is occurring at position W[i] of D. 

Returning to the computation for finding of K x and K 2 , we copy D[i ] to y[n-i+ 1] for 
each i in a single step and fill the array f with l’s. The V is the usual summation operator 
and '<’ is the usual less-than symbol Apply Generalized prefix computation on 
this, resulting in array E. We copy E[i] to E x [n - i + 1] for each i. For arbitrary i, E x [i] 
is the number of elements in D[i + l..n] which are less than D[i], 

Now, we form the array K x2 such that K 12 [i] = k x +k 2 of |C(i)| i.e, K x2 [i] represents 
the number of elements in D[i + l..n] which are less than d,- and and not equal to i. 

If (i + 1 < W[i) < n ) and (d,- > i) then K x2 [i] — E x [i] - 1 else Ki 2 [i] = Ei[i] 

Using the arrays E X ,M and K x2 , we obtain the arrays K x and K 2 . 

If i + 1 < D[i] < n then 

n — i — E x [i] values of D[i + l..n] are in the range [i + l..n] and greater than d,-. 

M[i + 1] values of D[i + l..n] are in the range [i + l..n]. 

Thus, M[i + 1] — (n — i — Ei[i]) elements of D[i + l..n] are in the 
range [z + l..n] and less than dj. 

K x [ 2 ] = M[i + 1] — (n — i — 

I<2[i\ = K 12 [i]-K 1 [{]-, 

else 

K x [{\ = 0; K 2 \i] = K 12 [i] 

Using K x ,K 2 and K 2 and Eq. (6.8) we get |C , (i)| for each i and then use Eq. (6.7) to 
get Rank(D). 

Theorem 6.8 We can find the rank of a derangement of n objects in O(logn) time with 
0[n log n) work on CREW PRAM when pre-processing is already assumed to have taken place. 

We have divided the calculation of rank into two parts - pre-processing and main 
processing. 

We can imagine a situation where we are given a set of derangements of n objects 
and we have to rank all of them. In such a situation, it will be better if we do those 
calculations which are same for each derangement —calculations done in pre-processing — 
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only once instead of doing them for each and every derangement. Suppose, we have to 
rank z number of derangements of n objects. Then the work is (z *nlogn + n 3 ) when 
the pre-processing is done only once. On the other hand, if we repeat the pre-processing 
for each derangement, then the work done is 0(z * n 3 ). If z = tu(l) then our first 
approach is definitely better than the second one and hence proves the importance of 
distinct pre-processing. 

6.5 Derangements from Permutations 

Every derangement is a permutation (throughout this section, by permutation we mean 
n-permutation) but not vice versa. So, if we are given all the permutations of n objects, 
they obviously contain all the derangements of n objects. Let us assume we are given all 
the permutations of n objects in lexicographic order. Then the problem is to put together 
all the derangements among them in lexicographic order. The following lemma is trivial: 

Lemma 6.9 The ordered list of derangements among all the permutations of n objects in lexico- 
graphic order will also be in lexicographic order. More over this list contains all the derangements 
ofn objects. 

Given the lemma, the easy approach to generate derangements from permutations 
in parallel is like this. First we identify those permutations which are derangements and 
later rank each of them in parallel and store them in the location given by their rank. 
But the problem with this approach is it has very high cost. If we use our 0(n 3 ) work 
and O(logn) time ranking algorithm (see Theorem 6.7) we will be able to generate the 
derangements in (3(logn) time with 0(n 3 n ! ) work which is clearly not optimal. So, now 
the question is how to generate the derangements optimally from the permutations in 
lexicographic order with the same time as above. We propose a novel method to tackle 
this problem. 

Instead of ranking all derangements, we rank only a selected set of derangements and 
the remaining derangements will obtain their ranks from the ranks of the selected set. 
More precisely, we divide all the n! permutations into sets ofn 2 consecutive permutations 
(the last set may contain less than n 2 permutations) each. Now we rank only the first 
derangement, called leader, from each set (if any) and then the remaining derangements 
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of the set will get their ranks by prefix sums using the rank of their leader. This approach 
works because the permutations that are given to us are in lexicographic order. 

6.5.1 Description of Algorithm 

We divide the given n! permutations into sets. Except possibly the last set all the 
other sets contain n 2 elements each. More precisely, the i-th set contains the permuta- 
tions with ranks from (i — l)n 2 + 1 to in 2 . The processing we are going to do for each 
set is same. We thus indicate the processing for an arbitrary set, say the i th set, and this 
processing should be done simultaneously and independently for each set. 

The i th set contains the n 2 permutations indexed from ai = (i — l)n 2 + l to b x = in 2 . 
For all the n 2 permutations, we would like to determine which of them are derangements. 
In a derangement the j th element should not be j for 1 < j < n. So, in O(logn) 
time and 0[n) work for each permutation we can determine whether it is a derangement 
or not on EREW PRAM. The task mainly involves finding the OR of n bits for each 
permutation. In O(logn) time with 0(n 3 ) work, we will classify each permutation of our 
set as a derangement or not. Based on this, we will form an array H such that H[j] = 1, 
if the j-th permutation is derangement or H\j] = 0, otherwise. 

The next task is to find the leader - the derangement whose rank we intend to find 
explicitly. We will define the leader for a set to be the first derangement in that set. 
Rephrasing, we need to find the position of first 1 in the array H. The finding of the 
first 1 can be done by a single application of prefix sum[25] on H. Let us denote by q 
the index of first 1 in H. Note that it is possible that the index q may not exist. This 
situation occurs when our set does not contain any derangements. In such a case the 
processors which are assigned to this set remain idle through out the processing. In any 
case, the leader of a set, if exists, can be found in O(logn) time with 0(n 2 ) work. 

We rank this leader derangement using our algorithm for ranking on EREW model in 
O(logn) time with 0(n 3 ) work (see Theorem 6.7). Note that we are using the version 
of ranking where pre-processing is part of ranking. Let us denote by s the rank of the 
leader. We set H[q] = s. 

Apply prefix sum on H to get the array P. After this step, every derangement of 
the i-th set has got its rank. Suppose, for arbitrary j, H[j] = 1, then the rank of 
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j ~ th permutation, which is a derangement is P\j]. This follows because the ordered 
derangements in the i-th set are consecutive derangements in lexicographic order. 

Once every derangement of the set has got its rank, we assign n processors to 
each permutation and those processors which are assigned to derangements write the 
derangement in the location indexed by its rank in an array meant for storing all the 
derangements of n objects. Those processors which are assigned to non-derangements 
remain idle. 

Summarizing, the derangements in a single set can be ranked in time O(logn) with 
0(n 3 ) work on EREW PRAM. 

As we have sets, the work for the entire algorithm is 0(n\n). It follows from 
Eq. (6.3) that, 

Lemma 6.10 The derangements in lexicographic order can be obtained from the permutations 
of n objects in lexicographic order in O(logn) time with optimal work 0(nD(n)) on EREW 
PRAM. 

The theorem given below follows from the above lemma as permutation generation 
has a lower bound of 0[n\ x n ) and since EREW is the weakest among PRAM models. 

Theorem 6.11 Given an 0(T ) time and 0(W ) work algorithm for lexicographic generation 
of all permutations of n objects, we can generate all the derangements lexicographically in 0(T + 
log n) time with 0(W ) work on the same model on which permutation generation algorithm runs. 

In Chapter 5 (see Theorem 5.3) we have described an O(logn) time and 0[n\n ) 
work algorithm for lexicographic generation of permutations on EREW PRAM. Using 
this algorithm and above theorem we obtain the following result. 

Theorem 6.12 All the derangements of n objects can be generated in lexicographic order in 
O(logn) time with 0(nD(n)) work on CREW PRAM. 
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Chapter 7 

Faster Optimal Parallel Algorithms 
for the Generation of Combinations 

7.1 Introduction 

In this chapter we discuss new parallel algorithms for enumerating combinations. We 
begin with some definitions. Let S be a set consisting of n distinct items say, the first n 
positive integers, i.e, S = {1,2, An r-combination of S is obtained by selecting 
r distinct integers out of S and arranging them in increasing order. Thus for n = 6 and 
r = 3, one 3-combination is (2 4 6). Two r-combinations are distinct if they differ with 
respect to the items they contain. The number of distinct m-combinations of n items is 
denoted by C(n,m), where C{n,m) = —[ ■ 

Thus for n — 4, there are four distinct 3-combinations. In the special case where 
r = n, C(n,n) = 1. 

Now, let x = (xiXi ...x n ) and y = (yiy 2 . . . y n ) be two r-combinations of S. We 
say that x precedes y in lexicographic order if there exists an integer i,l < i < r, such 
that Xj = yj for all j < i and x t - < y,-. If a combination A precedes lexicographically 
another combination B, we denote it by A ~< B. 

Each r-combination has an associated index in lexicographic order . By ranking 
we mean getting this index for an arbitrary r-combination. Similarly, unranking means 
getting the combination given its index. So unranking is the inverse operation of ranking. 
Our algorithm in Section 2 runs with a time complexity of 0(r). In Section 3 and the 


102 



Section 4 we will see two algorithms which are much faster. There is a thread running 
between both these algorithms; both are designed based on induction and recursion. They 
are inspired by [32] in which induction and recursion are used as a design technique to 
derive new and efficient algorithms. 

In the case of generation of r-combinations of n objects there are two parameters that 
are involved viz. r and n. The recursion can be applied on either of these parameters. 
The algorithm in Section 3 correspond to recursion on the parameter r (r-recursive 
algorithm) while that of Section 4 correspond to the parameter n (n-recursive algorithm). 

7.1.1 History and Related Work 

The problem of generation of combinations has a number of sequential[28, 36, 43] and 
parallel algorithms for its solution. An algorithm for generating all combinations in time 
0(C(n, r)/N)r log r) time with N processors appeared in [21]. A cost optimal parallel 
algorithm using r processors was presented in [10]. The algorithms in [2, 4] can employ 
up to C(n,r)/n processors. 

Previous cost-optimal algorithms for generating combinations have all used the fol- 
lowing strategy: a few combinations are generated by unranking, and the remaining are 
generated by an optimal algorithm for generating the next combination[2]. The algorithms 
in [4, 10, 41] parallelized the computation of the next combination to take constant time. 
The algorithms in [4, 41] run on a linear array of processors. The unranking algorithm 
used is a sequential algorithm which required 0(r 2 ) time per combination. The algorithm 
in [34] performs the unranking computation optimally and in parallel. It runs with a time 
complexity of O(r) with optimal number of processors. Our algorithms are different and 
are based on a divide-and-conquer principle. 


7.1.2 Preliminaries 

In this section, we present few basic concepts related to combinations for later easy 
reference. The reader is referred to [26] for proofs. 


C(n,r) 


(n — r)!r! 


(7.1) 
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C(n,r) = C(n,n — r ) 

(7.2) 

C(n,r ) = 0, when n < r 

(7.3) 

r<( n r '\ _ ( n )( n ~ — 2) ... (n — r + 1) 

(r)(r— l)(r — 2)...(1) 

(7.4) 

C(n,r ,) < C(n,r 2 ),if 0 < r, < r 2 < 

Lt 

(7.5) 

<7(72,7-!) > C(n,r 2 ),if L^J <r 1 <r 2 

(7.6) 

< C(n 2 ,r),if m < n 2 

(7.7) 


7.2 0(r) Time Algorithm 

Our first algorithm to generate combinations is based on a data structure which we 
call Combination Tree. A combination tree is similar to the permutation tree (see 
Section 4.2.1). Like a permutation tree which captures the notion of permutations in the 
form of a tree a combination tree does the same for combinations. All the combinations 
are represented in a succinct and simple manner as the paths in a tree. 

7.2.1 Algorithmic Interpretation 

We indicate the mathematical basis for the forthcoming algorithm which is based on 
building a tree of combinations. 

Consider the well known combinatorial identity[20]: 

J2 C{k, r) = <7(0, r - 1) + <7(1, r - 1) + . . . + C(n - 1, r - 1) = C(n, r) (7.8) 

k=0 

The above identity can be given the following algorithmic interpretation when we are 
generating the r-combi nations for n objects {1 . . . ti}. It is based on the concept that in 
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a combination the values are in increasing order. Suppose we consider r-combinations 
with prefix 1 .The Eq. (7.8) says that there are C(n — l,r — • 1) r-combinations with 
this prefix. More over the suffixes are nothing but r - 1-combinations of n - 1 objects 
{2, .. . ,7i}- In general, with z’ as the prefix, there are C(n — i,r — 1) r-combinations 
where the suffixes are the (r l)-combinations of n — i objects (z -f- 1 . . . nj. Obviously 
the prefix can be “z” where 1 < z < n. The above identity indicates all these possibilities. 
But note that if n z < r — 1 then there will not be any r-combinations with prefix “z” 
because then C(n — z,r — 1) = 0. The definition of combination tree, given below, uses 
this idea. 

7.2.2 Combination Tree 

We are generating all r-combinations of n elements of S. We assume that the elements 
of S can be ordered. Let 5[z] denote the zth element of set S. Similarly, we assume that 
S[i . . .j] denote array consisting of all the elements from 5[z] to 5{j]. 

Definition: An (n, r, ^-Combination Tree corresponding to the r-combinations of n 
objects present in S is a tree with the following properties: 

1. if r = 1 then the root has n children and zth child is labeled with the n — i + 1th 
element of S. 

2. if r > 1 then the root has n — r + 1 labeled children such that the label of u,-, the 
zth child, is S'jn — r + 2 — z] and the zth subtree rooted at z>,- is an (r + z — 2, r — 
1, 5[n — r + 3 — z . . . n])-Combination tree. 

It is easy to observe that, each subtree of an (n,r, S^-Com bination tree is a com- 
bination tree. The path (the concatenation of labels associated with the nodes in order) 
from any child of root to a leaf is an r-combination of n objects and we call this the 
combination associated with that leaf. Combinations associated with different leaves 
are distinct. Furthermore, the combination tree preserves the lexicographic order of the 
combinations in the sense that if a leaf v is to the right (defined below) of another leaf 
w, then the combination corresponding to v lexicographically precedes that of w. A leaf 
p is left of a leaf q if and only if there exists nodes s,t,u such that p is a descendant of 
t and q is a descendant of u and t and u are children of s and t occurs before u (for 
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Figure 1: Combination Tree when n = 4 and r = 3 


the relevant graph theory terminology refer to [14]). We give an example of combination 
tree in Fig.l. 

7.2.3 Algorithm 

Our algorithm builds a combination tree initially and then lists all the root to leaf paths 
to generate the required combinations. The algorithm works as follows. 

We are interested in generating the r-combinations of elements from S = {1,2, ... , n}. 
The root has n — r + 1 children and we associate a processor with each child. This pro- 
cessor copies its corresponding label and maintains the information needed so that a 
recursive call can be made. This processor also maintains the parent information needed 
to maintain the tree structure. 

Once the tree is built, we associate a processor with each leaf and it reads the path 
from root to itself to get the corresponding combination. A number is provided with each 
processor which is helpful in storing the combination so that we can list the combinations 
in lexicographic order. 

The algorithm is formally given in Fig. 2. In the algorithm, we depend upon the 
indentation to show the boundaries of statements. 

We explain the salient points of the algorithm. A label is associated with each node 
and it serves dual purpose. First, it represents the corresponding value in a combination. 
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Second, the label is useful in identifying the set of objects for which we are generating 
combinations for a particular recursive call. For example, if the label of a node is T then 
it means that this node is associated with a recursive call in which we need to generate 
the p-combinations for k + 1 to n objects; here r — p is the length of the path from root 
to the given node. 

The last step in the above algorithm is a parallel recursive call. One parameter in this 
recursive call is specifically provided for taking care of the processor allocation. It is a 
convention in general to identify which processors should be allocated for each procedure 
call. This information in general is provided through passing parameters to the procedure 
call. In fact, we can allocate the processors based on the model proposed by [9] using 
generic processor allocation (see Section 2.3 and Eq. (7.8)). 

Let us consider the procedure call GenJOomb(node,n,r,a). This procedure call 
says that we are interested in generating r-combinations of n objects. More over, the 
processors a to a + C(n,r ) — 1 should be allocated for this procedure call. In the above 
procedure call this processor allocation is facilitated by Eq. (7.8). 

7.2.4 Proof of Correctness 

Theorem 7.1 Algorithm correctly generates all the r-combinations in lexicographic or- 
der. 

Proof: We prove a much stronger statement. We prove that Gen.Comb(node,n,r,a) 
with node.label = x, generates the r-combinations of n objects {x-f 1 , x + 2, . . . ,x + n} 
and stores them in locations a to a + C(n,r ) - 1 such that they are in decreasing 
lexicographic ordering (ordinary lexicographic order is increasing). The theorem is a 
special case when nodel.label = 0 and a = 1. 

We prove this statement by induction on r. When r = 1, the statement is clearly 
true. Assume that the statement holds for r - 1 and we prove that it works for r. 

Consider the call, Gen-Comb(node,n,r,a). There are C(n -i,r- 1) combinations 
with x + i as the first value in the r-combination. In decreasing lexicographic order, we 
have first the C(r — l,r — 1) r-combinations with x + n — r + 1 as the first value in 
decreasing lexicographic order and followed by C(r, r— 1) r-combinations with x-f -n r as 
the first value in decreasing lexicographic order and so on. In general, with x-{-n— r— i+2 
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Algorithm Generate_Combinations(n,r) 

Begin 

N = n; R = r; 

Create_node(Root) ; 

Root . label = 0 ; 

Gen_Comb(Root,n,r,l) ; 

End; 

Algorithm Gen_Comb (node , n, r, a) 

Begin 

Create n-r+1 nodes, Node[l. . n-r+l] ; 

/* Copy labels */ 
for i = a to a+n-r in parallel do 
Node [i-a+1] .parent = node; 

Node[i-a+l] .label = n - r + 1 + node. label - (i - a) ; 
if (r == 1) then 

Write the reversal of the path from Node[i] to the child 
of the root as the combination in location i. 

// Write in location C(N, R) - i+1 for lexicographic order, 
for i = 1 to n-r+1 in parallel do 

Gen_Comb(Node[i] , r-2+i, r-1, a + C(r-2+i, r)); 

End. 


Figure 2; Algorithm to build a Combination Tree 
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as the first value, £j =1 0(r 2j,r 1) _ C(r — 2 + i,r) combinations precede it. So, 
the combinations with x + n-r-i + 2 as first value should start at a -f C(r - 2 + i, r ) 
in decreasing lexicographic order. More over there are C(n - (n - r - i -f 2), r - 1) = 
C(r + i — 1, r — 1) combinations with x + n — r — i + 2 as first value. By mapping that 
i th node in our algorithm to x + n — r — i + 2 as the first value, our claim is true by 
induction hypothesis. | 

7.2.5 Analysis 

The algorithm is building the tree level by level. Building a single level takes constant 
time. In other words we have the following theorem. 

Theorem 7.2 All C(n,r ) combinations can be generated in 0(r) time with C(n,r) 
processors on the CREW PRAM. 

Proof: We will prove the theorem by induction. We first prove that the time complexity 
is 0(r) by induction on r. 

When r = 1, the algorithm takes only one step. Let us assume the algorithm for 
r < k takes at most or time for some constant c. 

Now consider the case where r — k + 1 . In the algorithm, after taking a constant 
number of steps, there are n — r + 1 recursive calls. All these calls execute simultaneously. 
Hence the time complexity is T(k ) + 0(1) < Ci + ck < c(k + 1) = cr, if c\ < c. Hence 
our first claim is validated. 

We next show again by induction on r that processor complexity is 0(0(n, r)). For 
r = 1, clearly the number of processors needed aren — r+l = n — 1 + 1 = n. Hence 
the basis is proved since 0(n, 1) = n. 

Let us assume the claim is valid for r < k. 

For the case where r = k + 1, there are n - r + 1 recursive calls to Gen-Comb and 
by induction hypothesis the ith call needs 0(r - 2 + i,r - 1) processors. Hence the 
number of processors needed for these recursive calls is the summation shown below. 
£”=7 +1 0(r — 2 + i,r - 1) 

This summation is nothing but the summation shown in Eq. (7.8) when the zero 
terms in that equation are neglected (see Eq. (7.3)). 
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Hence the value of the above summation is C{n,r). Further, we need n-r + l 
processors for the processing that is conducted before the recursive calls are invoked. So 
the number of processors needed are max(n - r + 1 ,C(n,r)) = C(n,r). 

Hence our claim is validated. Further as in the algorithm, there are no simultaneous 
writes but simultaneous reads when a child reads the label of its parent, the algorithm 
can be implemented on the CREW PRAM. | 

The number of r-permutations of n objects is C(n,r ) and each combination is of 
length r. So combination generation has a trivial lower bound of 0(rC(n,r )) as we 
have to generate so much output. If we observe the cost[25] of our algorithm, it is 
0(rC(n,r)). Hence the above algorithm is cost optimal. 

7.3 The r-Recursive Algorithm 

7.3.1 Basic Algorithm 

The main idea behind the algorithm is as follows: suppose we are interested in generating 
all the r-combinations of n objects in lexicographic order. We would like to realize r- 
combinations when —combinations of n objects are available to us. So the algorithm is 
recursive. The termination of recursion occurs when r = 1 in which case obtaining the 
1-combinations of n objects is trivial. 

The algorithm in this subsection has the following restrictions: 

Assumptions: 

• r is a power of 2 and 

• r < f 

We relax these restrictions later (see Section 7.3.2). 

The algorithm is given below formally. 

Pr e JPr o cessing 

//calculate C(p,q) where q<r and for 

l < p < n. Store these values in a two dimensional array, com. 
for i = 1 to n*r in parallel do 
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// group and shift are local variables of each processor 
group = (i-1) div r + 1; 
shift = (i-1) mod r + 1; 

val[ (group- 1) * r + shift] = group + shift - 1; 

Calculate prefix multiplications of n segments of array val independently, 
where each segment is of length r and the i-th segment starts 
at (i — 1) * r + 1 . 
for q = 1 to r in parallel do 

for p = 1 to n in parallel do 
if q > p then com[p,q] = 0; 
else com [p , q] = val[(p-q+l-l)*r+q]/val[q] 

■N. 

Algorithm Generate_Combinations(n,r) 

Begin 

if r == 1 then 

for i = 1 to n in parallel do 
A[i,l] = i; 

else 

Generate_Combinations(n, £) ; 

Double-Size () ; 

End 

DoubleJ3ize() 

Begin 

Calculate for each "combination its associated "combination into array B 
Calculate Rank[i] for i = 1 to C(n,|) which is the rank 

of the corresponding first r-combination for each associated "combination . 
Processor Allocation; 

Copy needed values; 

End 

Algorithm Processor-Allocation 
Begin 
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for i - 1 to C(n,p in parallel do 
size [i] = com[n-ACi,|] 
if size[i] = 0 then 

start [i] = (Rank [i] -1 ) * r + com[n-B[i, §] , §]]*r + 1; 
end[i] = start [i] - 1; 
else 

start [i] « (Rank[i] -1 ) * r + 1; 
end[i] = start [i] + size[i] -1; 
p = C(n,r)*r ; 

Generic_Processor_Allocation; 

end 

We first describe the pre-processing steps. In the pre-processing, we find the values of 
C(p,q ) when q < r and for 1 < p < n. We find the prefix multiplication of consecutive 
values of length r for each starting value from 1 to n. This has been accomplished 
by an application of standard prefix multiplication algorithm [19] on these different sets 
independently and simultaneously. Once these values are found, we find the values of 
C(p,q ) in constant time for the given ranges of p and q using Eq. (7.4). 

The main algorithm is recursive in nature. The base case of the algorithm when 
r = 1 is trivial; the 1-combinations of n objects are simply the n objects in lexicographic 
order. The main procedure is DoubleSize( ) which given —combinations obtains the 
r-combinations. 

The idea behind Double Size is given an ^-combination, we would like to obtain all 
the (possibly none) r-combinations with that ^-combination as prefix. 

We will illustrate the ideas through an example. Consider the 2-combinations of 8 
objects {1,2 ... ,8} shown below in lexicographic order (top to bottom, left to right). 


112 



(1 2) (2 3) (3 5) (4 8) . 

(1 3) (2 4) (3 6) (5 6) 

(1 4) (2 5) (3 7) (5 7) 

(1 5) (2 6) (3 8) (5 8) 

(1 6) (2 7) (4 5) (6 7) 

(1 7) (2 8) (4 6) (6 8) 

(1 8) (3 4) (4 7) (7 8) 

Consider the 4-combinations of 8 objects {1,2... ,8} shown below. 

(1 2 3 4) (1 2 7 8) (1 4 6 7) (2 3 6 7) (3 4 5 7) 

(1 2 3 5) (1 3 4 5) (1 4 6 8) (2 3 6 8) (3 4 5 8) 

(1 2 3 6) (1 3 4 6) (1 4 7 8) (2 3 7 8) (3 4 6 7) 

(1 2 3 7) (1 3 4 7) (1 5 6 7) (2 4 5 6) (3 4 6 8) 

(1 2 3 8) (1 3 4 8) (1 5 6 8) (2 4 5 7) (3 4 7 8) 

(1 2 4 5) (1 3 5 6) (1 5 7 8) (2 4 5 8) (3 5 6 7) 

(1 2 4 6) (1 3 5 7) (1 6 7 8) (2 4 6 7) (3 5 6 8) 

(1 2 4 7) (1 3 5 8) (2 3 4 5) (2 4 6 8) (3 5 7 8) 

(1 2 4 8) (1 3 6 7) (2 3 4 6) (2 4 7 8) (3 6 7 8) 

(1 2 5 6) (1 3 6 8) (2 3 4 7) (2 5 6 7) (4 5 6 7) 

(1 2 5 7) (1 3 7 8) (2 3 4 8) (2 5 6 8) (4 5 6 8) 

(1 2 5 8) (1 4 5 6) (2 3 5 6) (2 5 7 8) (4 5 7 8) 

(1 2 6 7) (1 4 5 7) (2 3 5 7) (2 6 7 8) (4 6 7 8) 

(1 2 6 8) (1 4 5 8) (2 3 5 8) (3 4 5 6) (5 6 7 8) 

Let us consider r-combinations in lexicographic order of n objects. Note that lexico- 
graphic order is a total order [42] (i.e, for any two distinct r-combinations a and b either 
a lexicographically precedes b or vice versa). Suppose we consider the prefixes of length 
£ of r-combinations in order, then we can observe the following. 

Lemma 7.3 The prefixes of length i of r-combinations of {1,2, ... ,n} m lexicographic 
order will be in lexicographic order when i < r and adjacent duplicates are removed. 
More over, after adjacent duplicates removal these prefixes are the i-com binations of 
n — r + i objects S = {1 5 2 , . . . ,n — r + i}. 
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Proof: If these prefixes are not in lexicographic order, it is trivial to prove by contradic- 
tion that the original r-combinations are not in lexicographic order. 

So, after adjacent duplicates removal each prefix of length i occurs only once. Let 
us put together these prefixes in order as they are occurring in the r-combinations. 

We will prove that each of this prefix is a z-combination of S and that each i- 
cornbination of S must occur as exactly one prefix. Since it is already known that the 
prefixes are in lexicographic order, combining both the above statements results in proof 
of this part of the lemma. 

Consider an arbitrary prefix a 1 a 2 ...a t - of r-combinations. Then a { < n - r + z, 
otherwise, a r > n in which case it is obvious that this is not a valid prefix. Recall that 
in a combination the values are in strictly increasing order. Since, a,- < n — r + i, it 
follows that the given prefix is an z-combination of S. Hence we have proved that every 
prefix is an z-combination of S. 

Now, let us consider an arbitrary z-combination (&i& 2 . . . 6 t ) of S. Obviously, 6 t - < n— 
r+z. Attach the suffix (cic 2 . . . c r _,-) where cj = It is easy to observe that the newly 
formed sequence is a valid r-combination. Hence, it follows that every z-combination of 
S must occur as a prefix for some r-combination of n objects {1,2, . . .,n}. 

Hence, lemma follows. I 

From this lemma, we can observe that for each —combination there will be a set 
of r-combinations with this ^-combination as prefix. It follows from the lemma that atl 
these r-combinations will be together. 

In the above example, with 1 2 as the prefix there are 15 combinations and more 
over all these prefixes are together and the suffixes are in lexicographic order. But it 
is interesting to observe that for some ^-combinations there are no r-combinations with 
that —combination as the prefix. For example while 6 8 is a 2-combination, there are no 
4-combinations with 6 8 as the prefix. 

Consider an ^-combination (ai<z 2 ...a f ). If ar + § > n then there will not be 
any r-combination with this ^-combination as prefix. This can be easily seen as in a 
combination the values are increasing from left to right. 

We can strengthen our lemma. Once an ^-combination is given we want to char- 
acterize what are the suffixes that should be added in order that we can obtain the 
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corresponding r-combinations. This- will be very much helpful in the design of algorithm. 

Theorem 7.4 Given p-combinations of n objects {1,2, in lexicographic order 

and given any arbitrary prefix Ci,C 2 , . . . , c q which is a prefix of some p-combination there 
will be C(n—c q ,p—q) p-combinations with this prefix. The suffixes that should be added 
to this prefix are p - q-combinations of n - c q objects {c q + 1 , c 9 + 2, . . . , n}. More 
over all these p-combinations formed by adding the aforesaid suffixes are in lexicographic 
order and are consecutive p-combinations. 

Proof: Consider the prefix C = (ci,c 2 ,...,c,). Obviously, this is a ^-combination 
of n objects. Let us consider all p-combinations with this prefix. We now prove that 
all p-combinations with a given prefix will be together as consecutive. We prove by 
contradiction. 

Suppose they are not consecutive. Then there exist three p-combinations B\, B 2 and 
B 3 such that Bi, B 3 have the prefix = (qc 2 . . . c q ) and B 2 has a different prefix t 2 of 
length q and Bi,B 2 and B 3 are in lexicographic order (not necessarily adjacent). Since 
ti and t 2 are different and B\ precedes B 2 lexicographically it follows that t\ precedes 
t 2 lexicographically. But this implies B$ precedes B 2 lexicographically. A contradiction. 
Hence all the p-combinations with the same prefix are consecutive (or adjacent). 

Now it is easy to seek that the suffixes that should be added to this prefix C are 
coming from the set S = {c q + l,c 9 + 2,...,n}. This follows from the definition of 
combinations. Further, whatever the suffixes we are appending to the prefix C are (p-q)- 
combinations of S, as in a combination, by definition, the values will be in increasing 
order. Hence it suffices to prove that all C(n — c q ,p — q) p — ^-combinations of S are 
used and appear in lexicographic order. If p — q > n — c q then there will not be any 
p-combinations with the given prefix, which contradicts assumption that it is a prefix 
of some p-combination. We can formally prove by contradiction. Suppose an arbitrary 
p - ^-combination, D of S is missing. Now let us form a p-combination, by appending 
this suffix D of length p—q to our given prefix of length q. This is a valid p-combination. 
But all valid p-combinations must appear in the lexicographic order. Hence it contradicts 
that a particular p — ^-combination is missing. 

So, from this we conclude that all the p — q combinations of S are used for the given 
prefix. We have earlier proved that all the p-combinations with a given prefix will be 
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consecutive. Now to complete the proof we have to prove that the p - q -combinations 
of S in lexicographic order will be attached to the given prefix, suffixes of the given prefix 
will be in lexicographic order. 

This can also be proved by contradiction. Suppose that they are not in lexicographic 
order. There exists two p-combinations with the same above given prefix but whose 
suffixes are not in lexicographic order. That is one suffix does not lexicographically 
precedes the next one. But this contradicts that the p-combinations are in lexicographic 
order. Hence the theorem follows. | 

As a special case of the above theorem we obtain 

Corollary 7 .5 Let (0102 • • • , at) is an combination . The suffixes that should be added 
to this §- combination as prefix are nothing but the — combinations of {ol + 1,. .. ,n} 
in lexicographic order. I 

The above corollary needs a small qualification: if the cardinality of the set discussed 
above is less than £ then there are no r-combinations with the given prefix. 

So, once we know the suffixes that should be added to each —combination, it is easy 
to achieve our original goal - of forming the r-combinations. 

The needed combinations useful as suffixes can be directly obtained from our original 
list of |-combinations itself. Our next lemma elaborates on this. 

Lemma 7.6 Given C(n,r) r-combinations of n objects {1,2 ...n} in lexicographic 
order, the last C(i,r ) r-combinations are just the r-combinations of i objects {n — 
i + 1, . . . , n} in lexicographic order for all i, where, 1 < i < n. 

Proof: We will prove the lemma by induction on i. However, we will proceed from i to 
i — 1. 

As base case consider when i = n. Then it is obvious that our lemma is true. 
Assuming that the lemma is valid for the case i = k, we proceed to prove that it is valid 
for the case i = k — 1 . 

Based on induction hypothesis, the last C(k, r) r-combinations are just the r-combinations 
of k objects {n - k + 1 , . . . ,n}. Now consider these C(k,r) r-combinations which are 
in lexicographic order. All of r-combinations with n - k -f 1 as the first value will be the 
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first combinations using Lemma 7.3. From Theorem 7.4, there will be C(k - l,r - 1) 
combinations with this prefix. If we consider the remaining combinations excluding these 
combinations there will be C(k,r ) - C(k - l,r - 1) = C{k - 1 ,r) combinations. But 
all these combinations are from the objects {n - k -j- 2,. .. ,n}. Since we know that 
for k — 1 objects there will be C{k — l,r) r-combinations, it follows that we have all 
the r-combinations of these k — 1 objects. Obviously all these will be in lexicographic 
order (otherwise, we will contradict that the original list of r-combinations is not in 
lexicographic order). | 

From the above lemma, the suffixes that should be added to an ^-combination will 
be coming from the given —combinations itself. 

To get the algorithm, we also have to look at the problem of processor allocation. 
Processor allocation is non-trivial as different ^-combinations can have different number 
of r-combinations with them as prefixes. As we have seen we know how many processors 
we need for each —combination but for efficient implementation we should know which 
processors are to be assigned to each ^-combination. We can not use prefix sums as 
this will take unnecessarily long time as we are working with C(n, number of |- 
combinations. 

The ranking of combinations achieves the same effect as that of prefix sums but with 
a much better time complexity. For each ^-combination we would like to know which 
is the first r-combination with this ^-combination as the prefix. The following lemma 
provides the answer. 

Lemma 7.7 Given an combination (aia 2 . . . at) which is a valid prefix for the r- 
combinations, the first r-combination with this prefix is (aia 2 . . . atat T lat + 2 ... at + 

§)■ 

Proof: From Corollary 7.5, we know that the suffixes that should be attached to the 
above ^-combination are just the ^-combinations of the n - at objects {at + l,at + 
2 ,...,n}. But observe that the first ^-combination for the above list of objects is 
(at 4- la*- + 2 . . . at + £). Hence our lemma follows. i 

Now once we know the first r-combination corresponding to each applicable j- 
combination (some —combinations are not applicable as prefixes to the r-combinations), 
we find its rank. 
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We can find the rank of an r-combination in O(logr) time using r/logr processors, 
as we have to sum r values (see Section 2.2.2). 

Processor Allocation 

For each ^--combination which is applicable as a valid prefix for r-combination we 
find rank of the first r-combination with this §-combination as prefix. We also find for 
each "Combination the number of r-combinations with this prefix. 

We first would like to characterize a valid prefix in a more general setting. 

Lemma 7.8 A r-combination of n objects S = {1,2, . . . ,n}, A = (aia 2 ...a r ) is a 
valid prefix for some k-combination (k > r) of S if and only if m < n - k + i for all 
1 <i<r. 

Proof: The if part is simple since \f a r < n — k + r then A is also a r-combination 
for n — k + r objects {1, 2, . . . , n — k + r}. But by Lemma 7.3, every r-combination of 
n — k + r objects {1, 2, . . . , n — k + r} is a valid prefix for some ^-combination. 

The only if part is also equally simple. If A is a valid prefix for ^-combination then it 
must be the case that a,- < n — k + i. Otherwise, we can not form a valid ^-combination 
as the elements are strictly increasing in a combination. Thus, if a,- > n — k + i for some 
i, then ajt must be greater than n. Then, it follows that A is not a valid prefix. I 

From the lemma it follows that some "Combinations are not valid prefixes for r- 
combinations. But even in such a case, we must know, how many processors are used 
by the valid —combinations that come before it. This is necessary for the our pro- 
cessor allocation procedure (see Section 2.3). To facilitate this case and to make the 
approach more uniform we define associated combination. Each —combination has got 
an associated —combination, which is the same as the ^-combination if it is a valid 
prefix for r-combinations. If it is not a valid prefix, the associated ^-combination for the 
given ^-combinations is the nearest lexicographically preceding ^-combination which is 
a valid prefix for r-combinations. The calculation of the associated ^-combination for an 
^-combination is facilitated by the following lemma which is given in more general form 
because of its use in a later section. 

Lemma 7.9 Given an r-combination, A = (0102 • • • a r) °f n objects S = {1,2, . . . ,n}, 
the nearest lexicographically preceding (or same) r-combination which can act as the 


118 



prefix of k-combination (k > r) of.S, is given by (b^ ...b r ) where b { = n - k + i if 
a,i > n — k + i else bi = a t - . 

Proof: In B = (6162 • • • b r ), if bj < ay, then bi = n — k — l, for all j < l < r, as if 

°i > n — k + i then a; + 1 > n — + i + 1 (since in a combination the values are in strictly 
increasing order). 

So, let us denote by m the maximum integer such that ay = bj for all 1 < j < m. 
Note that bj = n — k + j for m + 1 < j < r. 

Using Lemma 7 . 8 , if C = (cic 2 ... c r ) is a valid prefix for fc-combination then it must 
be the case that c,- < n — k + i for 1 < i < r. 

We observe that, B is a valid prefix for ^-combination and more over bi < a,- for all 
1 <i <n, and hence B lexicographically precedes A or is same as A. 

Obviously if A = B, then our lemma is true. 

So, let us consider the case below where A^ B. So, in that case, B lexicographically 
precedes A. 

we prove the lemma by contradiction. Let us assume that B is not the nearest valid 
prefix for A and D = (did 2 ...d r ) is the correct one. Then, B -< D < A. 

Since, a,- = bj for 1 < j < m, it follows that dj = ay for 1 < j < m. Let us 

assume m\ the minimum index for which bj < dj. Such an index must exist since B 
lexicographically precedes D. Obviously mi > m. Note that as b mi = n — k + mi, 
d m j > n — k + m 1 which implies that D is not a valid prefix for ^-combination by 

Lemma 7 . 8 . Hence a contradiction. So, the lemma is proved. I 

By the above lemma it is apparent that, we can obtain the associated —combination 
for each —combination in constant time with | processors. 

We need to allocate rC(n, r ) processors for building the r-combi nations as there are 
C(n,r) r-combinations. For each of these processors we need to allocate work. For 
each |-combination we need to find all the r-combinations with this ^-combination as 
prefix. Hence there is a task corresponding to each ^-combination. For each processor 
we need to inform to which ^-combination does it belong to. We also need to know 
the index of each processor with respect to the processors that are allocated to each 
^-combination. Using this information, it is easy to copy the respective information to 
build r-combinations. 
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In our algorithm we indicated ho.w we obtain this information by using an application 
of generic processor allocation. 

Using the details available from processor allocation a processor/) proceeds as follows. 
Let s = (p — 1) div r + 1. Then processor p will be working towards obtaining the s-th 
r-combination in lexicographic order. Suppose p belongs to G\p] = a-th ^-combination. 
Then processor p is the N\p ] = b th processor that are allocated to a-th "combination 
in order. Assume a th "Combination is the prefix for c r-combinations. Let d=(b- 1) 
div r + 1. Then p-th processor should work to form d-th r-combination with a-th ~ 
combination as prefix. Let e = (6 — 1) mod r + 1. Then p-th processor should obtain 
the e-th item of the r-combination on which it is working. If e < then p-th processor 
will obtain the e-th item of —combination to which it belongs and writes it in the correct 
position. If e > | then it needs to obtain the value from the end of the "Combinations 
depending on its position. 

To accomplish this we need to know to which ^-combination each processor belongs. 
First we obtain the ranks of the "combinations which act as the first r-combination 
with that prefix. Consider ta-th arbitrary "combination. Let its rank as the prefix of 
the first r-combination be u. Similarly let us assume that the number of r-combinations 
with this "Combination as prefix be v. Then the processors numbered ( u — l)r + 1 to 
(■ u — l)r + vr should be allocated for this "combination. On the other hand, for those 
"Combinations which are not valid prefixes for r-combinations, we have obtained its 
associated "Combination and using the associated combination, we obtain the values of 
arrays start, end and size for generic processor allocation. Using this information, we 
apply generic processor allocation (see Section 2.3). So each processor knows to which 
"Combination it belongs to and what is its index among the processors allocated to that 
"Combination. 

We now analyze the algorithm. 

First look at the preprocessing. In the first step we are initializing tables which needs 
constant time and nr processors. In the next step we are finding the prefix multiplications 
of a number of segments of equal length simultaneously using the standard algorithm 
for prefix multiplication[25]. It has a time complexity of O(logr) as each segment is of 
length r. The total work done is 0(nr) as the prefix multiplication algorithm is optimal. 


120 



Once this processing is over, we find the values of C(p, q) where p varies from 1 to n 
and q varies from 1 to r. This is calculated using Eq. (7.4) and can be done in constant 
time with nr processors as it involves retrieval of two values and their division. Thus, 
the total time for the pre-processing is O(logr) with a work of 0(nr). 

Now we analyze the time complexity and work of main part of our algorithm. Recall 
that r is a power of 2 and r < f . Let T(n,r), W(n,r ) denote the time complexity and 
work done when we are generating r-combinations of n objects respectively. 

The algorithm is recursive and the main part involves the analysis of Double.Size(). 

Double-Size obtains the r-combinations from r-combinations. We assume that the — - 

4 2 

combinations are available in an array. We initially find the number of r-combinations that 
are associated with each —combination. This can be done in constant time with C7(n, §) 
processors. Then we find the associated ^-combination for each —combination in con- 
stant time. After that for each ^-combination, we find the rank of the first r-combination 
with its associated —combination as prefix. This calculation involves C(n, |) independ- 
ent summations and can be done in O(logr) time with a work of 0(C(n, |).r). 

Once the calculation of ranks is over, we do the processor allocation. From Section 
2.3, this can be done in 0(loglog *{C(n, |) + C(n,r).r)) time with 0(C(n,r).r + 
C(n , |)) work on CREW PRAM. Once this is done each processor copies the needed value 
from the |-combinations to form the r-combinations in constant time with 0(C(n,r)r ) 
processors. 

When r = 1, the algorithm takes constant time and n processors. Thus, we form the 
following recurrence relations. 

f r(n,f) + 0(loglog*(C(n,§)-f-a(n,r).r)) + 0(logr) if r > 1 

T( "’ r)= \ Cl ifr = l 

where cj is a constant. 

The above equation can be simplified by observing that C(n,r).r = 0(n r+1 ). 
Hence 0(loglog*(C(n, 5 ) + C(n,r).r)) = 0(loglog*(n r+1 )) = O(log(log*(r + 1) + 
log *n )) = 0(log log *r + log log *n). Thus, 

T(n,r) = T(n,§) + c 2 . log r + c 3 . log log *n. 

where C2 and C3 are constants. 
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Our algorithm employs induction- on r and hence the algorithm goes log r levels deep. 
Using this[13] 

T(rc, r) = O(log r(log r + log log *n)) 

For work performed by the algorithm, we can obtain the following recurrence relation: 

W(n,r) = { W ( n ^) + h-C(n,r)r if r > 1 
[ k 2 .n if r = 1 

where k x , k 2 are constants. (Note that we used Eq. (7.5)) 

We formally show below that W(n,r) < 2ki.C(n,r).r 
Proof: The proof is based on induction on r. 

As base case consider when r — 1. From the algorithm we know that W(n, 1) = 
k 2 .n < 2ki.iT, = 2ki.C(n , 1 ) if 2ki > k 2 . 

For the induction hypothesis, let us assume W(n, r) < 2k 1 .C(n, r).r for r < 2 k . Let 
us consider the case 2 r 

W(n,2r) = W(n,r)+ki.C(n,2r).2r < 2ki.C(n,r).r+ki.C(n,2r).2r = k x .C{n,r).‘t 
ki.C(n, 2r).2r < ki.C(n,2r).2r + ki.C(n,2r).2r 

since according to our restrictions, 2r < | and using Eqs. (7.5) and (7.6). 

Thus, W{n,2r) < 2fc 1 .C'(n, 2r).2r 

Hence our claim follows. I 

Generation of r-combinations has a lower bound of 0(C(n,r).r). So our algorithm 
is optimal. 

Putting all these together leads to the following theorem. 

Theorem 7.10 Algorithm works with a time complexity of 0 (log 2 r + log r. log log *n) 
with optimal work and on CREW model when r is a power of 2 and r < |. I 

On the other hand, if we use COMMON CRCW PRAM then Theorem 2.4 will be 
applicable for processor allocation and we can show that, 

Theorem 7.11 Algorithm works with a time complexity of 0 (log r(logr + a(n)) with 
optimal work and on COMMON CRCW model when r is a power of 2 and r < |. I 
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7.3.2 Generalization of the Algorithm 

In the above section, we have seen that the r-combinations will be generated only when 
r is a power of 2. In this section, we generalize that algorithm to the case where r is not 
a power of 2. But the other restriction r < f remains. This restriction, we will remove 
in Section 7.3.3. 

This generalized algorithm uses the original algorithm. The approach that is used in 
the generalized algorithm in its basic form is same as that of the restricted algorithm. 

The algorithm is given below. 

Pre-Processing 

Calculate the values of C(p,q) for 0 <p < n, 0 < g < r. 

Algorithm Generate_Combinations_Generalized(n,r) 

Begin 

t ! is the laxgest integer such that 

a) ri < r and 

b) r\ is a power of 2. 

c) r 1 + r 2 = r. 

Generate_Combinations(n,r!) ; 

// Let these ^-combinations be stored in the array A[l. .C(n,ri) , l..r x ] 
q = ri - r 2 ; 

Store the suffixes of length r 2 of the first C(n — q,r 2 ) 
rj -combinations in the array B[l..C(n — q,r 2 ),l..r 2 ]; 

Increase_Size() ; 

End 

Increase_Size () 

Begin 

// Increases the size of the rx-combinations to become r-combinations. 
Obtain the associated r 2 - combination for each rj -combination; 

Calculate the ranks of associated r\ -combination as first r-combination 
Calculate the number of processors; 

Processor Allocation; 

Copy needed values; 
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End 


Let r x be the largest power of 2 less than or equal to r. So, r x is the value of the 
most significant bit of r. 

Based on the value of r x , we can make the following observations. 

Observations 

1. r x < r 

2- r, > fjl 

3. ^ < LSJ 

We generate rx-combinations of n objects using our earlier algorithm. These r x - 
combinations are stored in a two dimensional array A. Now we obtain r-combinations 
using these ri-combinations. In our earlier algorithm, we used DoubleSizeQ to achieve 
this. In this case we use IncreaseSize() for similar purpose. 

If we observe rx-combinations, each of rx-combination act as a prefix for some num- 
ber (possibly none) of r-combinations. All prefixes of length r x of the r-combinations are 
in lexicographic order by Lemma 7.3. More over each prefix is a valid rx-combination. 
Hence we essentially add the suffixes of length r 2 to these rx-combinations to make them 
r-combinations. Further, these suffixes that need to be added to these rx-combinations 
can be obtained from these rx-combinations itself. Consider an arbitrary rx-combination, 
(did 2 . . ■ d r J. The suffixes that should be added to this rx-combination are r 2 combina- 
tionsof n-d n objects viz. {d ri + l,d ri +2,...,n} by Theorem 7.4. If n-d n < r 2 then 
there are no r-combinations associated with this prefix. So for each rx-combination, we 
need to obtain ^-combinations for some set of objects. These set of objects are always 
of the form {si, si + 1, . . . ,n} for some arbitrary s x . The minimum si occurs when the 
rj-th value of a rx-combination is minimum. The minimum rj-th value that is possible 
for an n-combination isrj. This corresponds to the first rx-combination viz. (12... rx). 
This rx-combination needs ^-combinations from the set of objects {n -f 1, n +2, . . . , n} . 
The recombinations for other set of objects {Mi + 1, — can be obtained from 
the above set of objects provided t x > rx + 1. This follows from Lemma 7.6. So, if we 
some how get the ^-combinations of n - r x objects {n + l,rx 4- 2,. .. ,n} then our 
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work is essentially done. Note that by Lemma 7.6, recombinations of the set of objects 
+ 1,. . . ,n} also suffices when v x < n + 1. 

Let q = n — r 2 . Let us consider the ri-combinations. The first recombination is 
(12. . . Ti). There will be C(n — g,r 2 ) rj-combinations with prefix 1,2 More over, 
by Theorem 7.4 they are just the recombinations of n — q objects + 1, q -+• 2, . . . , n}. 
Further by Theorem 7.4, the first C{n — q,r 2 ) combinations have the same prefix 
1,2 — ,q of length q. Hence these C(n — q, r 2 ) suffixes of length r 2 correspond to the 
r 2 -combinations of n-q objects {q + 1, q + 2, . . . , n}. As q < r lf these are the needed 
set of recombinations. So all the r 2 -combinations needed can be obtained. These 
suffixes are stored in an array B. Using Lemma 7.6, we can obtain the needed set of 
r 2 -combinations for any set of objects. More specifically, suppose we are interested in 
obtaining the recombinations of objects {u;,u>+l,...,n}. Assume thatto > g+1. Then 
the needed set of recombinations can be obtained by taking the last C(n — w + l,r 2 ) 
combinations from the above set of recombinations. 

Now we have the essential information needed to form the r-combinations. After 
this, we proceed in manner similar to that of our earlier algorithm. This details of 
Increase-Size () are very similar to DoubleSizeQ. 

Let T(n,r), W(n,r) denote the time complexity and the work done by the generalized 
algorithm respectively. 

We invoke the earlier algorithm for generating combinations with parameters n, r x . 
Hence based on Theorem 7.10, this takes a time of O^ogr^log r x + loglog*n)) and a 
work of 0(C(n, ri).ri). 

We then invoke Increase-Size to obtain the r-combinations from these ri-combinations. 
This takes a time of 0(log r + log log *n) and work of 0{C(n, r x ).r + C(n, r).r). Thus, 

T(n,r) = Ci. log r 1 (logr 1 4- log log *n) 4- c 2 .(log r + log log*n) where c x and c 2 are 
constants. Since r\ < r, n > | and r < 

T(n,r) = O(logr(logr +loglog*n)) 

The work done by the algorithm is: 

W(n,r ) = c 3 .C'(n,r 1 ).r 1 + c A .C{n,r x ).r + c 5 .C(n,r).r where c 3 , c 4 and c 5 are 
constants. 

Here, W(n,r) = 0(C(n,r).r) 
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So we obtain the following theorem 


Theorem 7.12 Algorithm optimally generates the r-combinations of n objects in lex- 
icographic order with a time complexity of 0 (log r(log r + log log *n)) on CREW PRAM 
when r < |. I 

Using Theorem 2.4 for processor allocation, we can show that 

Theorem 7.13 Algorithm optimally generates the r-combinations of n objects in lex- 
icographic order with a time complexity of 0 (log r(log r + a(n))) on COMMON CRCW 
PRAM when r < § . ■ 

7.3.3 Generalization of the Algorithm (Case r > rti) 

Till now we have assumed that r < \ in our algorithm. We next remove this restriction. 
Suppose that we are interested in generating r-combinations of n objects where r > 

We give an algorithmic interpretation to Eq. (7.2). If we are interested in generating 
r-combinations, then we can initially generate n— r-combinations of n objects; each n-r- 
combination represents the objects we have selected. But if we consider the objects we 
have not selected they will be r objects corresponding to each n — r-combi nation. In 
other words there is a one-to-one correspondence between each r-combination and n — re- 
combination. Instead of generating r-combinations we first generate n — r-combinations 
using above algorithm. Since r > f, n-r < § and above algorithm is applicable. Once 
we have generated the n- r-combinations, we will generate r-combination corresponding 
to each n — r-combination. 

For each n - r-combination, we allocate an array of length n. In that array we put 
l’s for each object that are selected and 0’s for them that are not selected. So, we bring 
together the objects that are not selected by a single application of prefix sum. However, 
the resulting r-combinations may not be in lexicographic order. But fortunately they are 
in decreasing lexicographic ordering. This is proved in Lemma 7.14. 

Lemma 7.14 Given n — r-combinations of n objects in lexicographic order, the corres- 
ponding r-combinations will be in decreasing lexicographic order. 
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Proof: Let P x and P 2 be arbitrary consecutive n — r-combinations in lexicographic 
order. Let Q 1 and Q 2 be their corresponding r-combinations. Then we will prove that 
Q 2 ■*< Qi', the lemma follows as lexicographic ordering is a total ordering. 

First we look at the problem of determining the next combination given an arbitrary 
combination. 

Let Pi = (a x a 2 . . . a n _ r ) and P 2 = ( bib 2 . . . 6 n _ r ). 

Then suppose i is the maximum index for which a; < n — (n — r) -f i for 1 < 
i < n - r. Then bj = aj for 1 < j < i - 1, = a t - + 1 and bj = 6j_i + 1 for 

i + — ^[33] (i must exist since P x is not the last (n — recombination). More 

over, since a,- < n — (n — r)-\-i then a; +1 = n — (n — r)-\-i + l and hence a, + i — a,- > 2. 

Let us consider the formation of Q x and Q 2 from P x and P 2 respectively. Recall 
that in a combination the objects are in increasing order. Let Q x — ( cic 2 ...c r ) and 
Q 2 = {d\d 2 . . . dr). 

Since bj = aj for j varying from 1 to i — 1 , it follows that c* = dk whenever c* < a,-. 
Let m be the largest such k. Since fe t - = a, + 1. Now d m+ i = a,- but Cm + 1 > d m+ x . 
Hence, Q 2 lexicographically precedes Q x . Hence our lemma follows. I 

Based on this lemma it is easy to lexicographically order r-combinations; just put i 
th combination at C(n,r) — i - f 1 place. 

We analyze the algorithm. We use the usual notation for the time and work. 

For generation of r-combinations of n objects in this case, we initially obtain the n— r- 
combinations of n objects. This takes a time of 0(log(n — r)(log(n - r) + loglog*rc) 
and a work of 0(C(n,n — r).(n — r)) by Theorem 7.12. After this we take a time of 
O(logn) and a work of 0(C(n, n — r).n). Thus, 

T(n,r) = C!.log(n - r)(log(n - r) + loglog*n) + c 2 .logn 
or, T(n,r) = O(logr(logr + log log *n)) 
since r > |, n = O(r). 

Similarly, 

W(n, r ) = c 3 .C(n, n - r).(n - r) + c 4 .C(n, n - r).n 
where c 3 and c 4 are constants. 

Since C(n,r) = C(n,n — r) and r > |, 

W(n,r) — 0(C(n,r).r) 
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So combining all of our cases, we obtain the following theorem. 

Theorem 7.15 We can generate all the r-combinations in lexicographic order and op- 
timally with a time complexity of 0(log r(log r log log *n)) on the CREW PRAM. 

I 

Using theorem 2.4 for processor allocation, we can show that 

Theorem 7.16 We can generate all the r-combinations lexicographically and optimally 
with a time complexity of 0 (log r (log r + a(n))) on the COMMON CRCW PRAM. I 

7.4 The n-Recursive Algorithm 

In this section, we discuss an algorithm to generate combinations with recursion on n. 

7.4.1 Basic Algorithm 

Like our first algorithm this algorithm is also based on giving algorithmic interpretation 
to a well known combinatorial identity. This reinforces our belief that algorithmic inter- 
pretation of combinatorial identities provides a good basis through which we can design 
parallel algorithms. 

Our algorithm is based on Vandermonde’s Convolution [ 26], 

' 'Y J C{mi,k)C(m 2 ,r - k) = C(m x + m 2 ,r) (7.9) 

it 

We give a combinatorial interpretation^] to this identity. Suppose we are interested 
in forming a team of r members out of m x + m 2 persons. We would like to know how 
many such teams we can form. Out of these persons m x are male and m 2 are female. 
The teams can be formed in the following ways. We can select k males out of the mi 
males and r-k females out of the m 2 females. We can select k males out of m x males 
in C{m u k) ways and r- k females out of m 2 females in C{m 2 ,r-k) ways. Since both 
these possibilities are independent, there are C{m x , k)C(m 2 , r-k) possible teams for a 
given valu^.of k. We get different possibilities based on different values of k. All teams 
that are formed are different. This exhausts all the possibilities. The left part of the 
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identity specifies the number of possible teams that we can form. The identity follows 
as we can form a team of r members out of mi -f m 2 persons in C(mi + m 2 ,r) ways. 

We use a special case of this identity when mi = | and m 2 = \ shown below 
(assume n is even). 

tc&k)C(^r-k) = C(n,r) (7.10) 

We can give the following algorithmic interpretation to the above identity. Suppose 
we are interested in generating r-combinations of n objects. Then the above identity 
specifies that we can select k objects out of first | objects in C(j,k ) ways and select 
the remaining r — k objects from the other set of | objects in (7(f ,r — k ) ways. Since 
both these are independent and we have to do both the operations, this can be done 
in C(|,fc).C'(|.r — k ) ways. For different values of k this leads to different selections. 
All these are disjoint. Hence these exhaust all the possible r-combinations that we can 
obtain. 

In the above interpretation, while we are interested in generating r-combinations of n 
objects, we have to solve subproblems where we have to select k objects out of | objects 
for varying values of k. So, here the recursion is on n. The number of recursive calls 
depend on the value of r at a particular level of recursion. 

We make the following assumptions in this section. 

Assumptions: 

• n must be a power of 2. 

• r <f 

We will relax these restrictions in Section 7.4.2. 

The identity in Eq. (7.10) can be made more precise by eliminating zero terms using 
Eq. (7.3). 

E C( k).cQ, r — k) = C{n , r), if r < | (7.11) 

k = 0 ^ 

E C&,k).C(^,r-k) = C{n,r), if r > ^ (7.12) 

i t=r— a ^ 
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Each term in the identity (7.10)' is a product of two binomial coefficients and hence 
represents two recursive calls. If one of them is zero then we have unnecessarily generated 
both the recursive calls whose result we are not going to use. But as this consumes 
resources, we have removed all the zero terms. In Eqs. (7.11), (7.12), we have two 
recursive calls for each term and they are useful in the final computation i.t, the generation 
of r-combinations. 

We next study what are the specific recursive calls that will be made in the recursive 
algorithm based on the above identities. (Note that when we generate p-combinations 
of some set of q objects, we generically call it as a recursive call for p-combinations of 
q objects.) 

Lemma 7.17 Assume we are generating the r-combinations ofn objects, where r < j 
and n is a power of 2, using the recursive algorithm based on Eqs. (7.11) and (7.12). 
As part of the recursive algorithm we generate p-combinations ofm objects if and only 
if m is a power of2,m<n and p < min(m,r). 

Proof: Since n is a power of 2, let n = 2 s for some integer s. We prove the lemma by 
induction on s and go from s to s — 1. 

Note that the recursive algorithm is based on divide and conquer and based on the 
identities (7.11) and (7.12). It is obvious that we will be calculating combinations of 
m objects where m is a power of 2 and m < n. This holds for all number of objects of 
size 2’ where i varies from 0 to s — 1. 

So, our main task is proving that the recursive calls are made for the p-combinations 
where p is as indicated in Lemma. 

Let us consider the if part of lemma. As basis, we consider the case when we are 
generating combinations for f objects. In fact these are first set of recursive calls that 
are made. Since r < f, Eq. (7.11) is applicable and we will be generating p-combinations 

of | objects where 0 < p < r. 

As part of induction hypothesis, we assume that the Lemma is valid for the case 
of % objects. Here q < s. That is we generate p-combinations for £ objects when 
0 < p < mm(r, ^-). Now we have to prove that the lemma is valid for case of 2 ,+t 
objects. That is we generate the p-combinations for the number of objects where p varies 

from 0 to min(r, 2 ^r). 
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For arbitrary t, consider the t-combinations of objects where t lies in the range 

0 to min(r,^r). 

Since ^ it follows that t definitely lies in the range 0 to mm(r, ^). From 

induction hypothesis we know that we generate t-combinations of ^ objects. But let us 
consider the recursive call correspond to this generation of combinations. We observe 
that since t < min(r, ),t < it follows that in the generation of 

t-combinations of % objects we will be using the Eq. (7.11) where t = r. But if we 
observe the first term in that identity, we find that we need to calculate the t-combinations 
of objects. Since t we have chosen is arbitrary, the proof of the first part of lemma 
is complete. 

Note that in identities (7.11) and (7.12), all terms are non-zero which implies that 
each recursive call produces non-zero number of combinations. 

We next prove the only if part of Lemma. This can be easily proved, as in generation 
of r-combinations we never generate p-combinations of any number of objects when 
p > r. If p > u then we never generate p-combinations of u objects. Hence our lemma 
follows. I 

As the identity indicates, we have a number of recursive calls for the generation of r- 
combinations. We have to use parallel recursion, where the number of recursive calls will 
be more than one. We avoid parallel recursion by implementing the algorithm bottom-up. 
We first execute all the calls where we generate {-combinations for 1-object. Then we 
generate the combinations for 2-objects and so on until we generate the r-combinations 
of n-objects. 

In the bottom-up approach we will be obtaining i-combinations for varying values of 

1 for the same set of objects simultaneously. But the number of processors that we need 
for each call are not same. Hence the necessity to determine which processor do which 
work. So, in the pre-processing for the algorithm, we will determine what processor will 
do which work for the entire main processing. The algorithm is given in Fig. 3. 
Pre-processing 

In main procedure we have to calculate binomial coefficients at a number of places. 
We will calculate for 1 ^ p n and 0 ^ <y — r ®^d store them. This is 

done in pre-processing as follows. Apply prefix multiplications[25] on the array A already 
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initialized with A[i] = i for 1 < i < n. After prefix multiplication, A[i] = i\. So, once 
we have calculated the factorial values, we use Eq. (7.1) calculate the value of binomial 
coefficients. 

Once the calculation of binomial coefficients is over, we do processor allocation. 

We now introduce notation which will be used in our presentation. We refer the 
generation of combinations for a particular number of objects as one level. The ith 
level corresponds to the generation of combinations for 2* objects. So, there are in 
total log n + 1 levels from 0 to logn. We refer the level where we are generating 
the combinations for n objects as the top level. We also refer the level where we are 
generating the combinations for 1 object as the bottom level. 

All the calls related to a particular level of recursion will execute simultaneously. The 
processors from one level will be used in the next level. 

The processor allocation for a particular call will be based on the Eqs. (7.11) and 
(7.12). The above equations provides us with details of how to form the given set of 
combinations for a given set of objects and also the number of processors needed and how 
we should distribute them. But we should recall that the Eqs. (7.11) (7.12) specifies only 
the number of combinations that we will be obtaining but not the number of processors 
that we should devote. We will be allocating p processors for each p-combination. If we 
multiply by p for the equation to generate p-combinations that will suffice in terms of the 
needed processors. That is for generating the p-combinations of k objects, we will be 
allocating the number of processors for each term such that we will have one processor 
for each item of a combination. 

Of logn + 1 levels, we consider the top leyel and the bottom level separately. The 
remaining levels will be considered in a uniform fashion. For all the levels except the top 
level, we generate all the p-combinations for p varying from 0 to min(m,r) where we 
want to generate these p-combinations for m objects. 

For each level of recursion, we will try to find the number of processors needed for 
p-combinations of m objects where p varying from 1 to r instead of p varying from 1 to 
min(m,r). The modified range for p simplifies the processing with no change in work, 
for those p which are outside the allowed range, no processors will be allocated. 

There are logn - 1 levels for which we have to do processor allocation - level 1 to 
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level logn — 1. In each of these levels, there will be r recursive calls. We create an array 
C of length (log n - 1 )r(r + 1) such that the locations (i - l)r(r + 1) + 1 to »r(r + 1) 
correspond to level i. Suppose level i starts at START then the processors allocation 
details for the jth call in level i correspond to locations START + (j - l)(r + 1) to 
START + j(r + 1) — 1. These locations will be filled based on Eq. (7.10). Note that 
even though we are not using Eqs. (7.11), (7.12), the extra locations will contain zeroes 
and hence no processors will be allocated to them. 

We apply prefix sums on this array C. Let the result be in D. We consider each 
location of D as specifying a task to be done, with the needed number of processors as 
specified in the array after prefix summation. We then apply generic processor allocation 
(see Section 2.3). The calculation of the arrays needed like start, end and size and 
the value p are specified in the algorithm itself and are self explanatory. 

Once generic processor allocation is done, we will get the arrays G and N from it. 
From now onwards, we refer the array G as Alloc and the variable p by Total which 
denotes the total number of processors that are used in the (logn — 1) levels. 

Let us assume that d t - denotes the number of processors we need for level i. More 
over let e;’s denote the prefix sums on this array d,-. We calculated e t - as part of obtaining 
array D. The first dj locations of the array Alloc provide the processor allocation details 
for level 1. Similarly the next locations provide the processor allocation details for 
level 2 and so on. In other words, the locations of Alloc array, e,-_! + 1 to e* provide the 
processor allocation details for the level ^(Assume e 0 = 0.). The d,- processors for level i 
will be knowing about their work assigned to them by looking at the locations e,_i + 1 
to e,- of Alloc in order of the processors( i.e 1 st processor looks at the location e,_i + 1, 
second processor looks at the location e,_i + 2 and so on.). 

We indicate how a given processor j finds the work assigned to it. Suppose processor 
j is assigned to the location i of Alloc. Let us assume Alloc[i\ contains q. Suppose 
the processor is assigned to the generation of ^-combinations. The level in which we are 
operating is already known as the algorithm proceeds sequentially in terms of processing 
of levels. Recall that each ^-combination's call has r + 1 parts; though some parts may 
be null, but processors will always be assigned to useful parts only. Let us also assume 
that of the ^-combinations the processor belongs to t th part of the fc-combinations. We 
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would like to know what is the number of our processor out of the processors that are 
needed for the part t. This is iV[i] . Once this is known, we can easily identify the work 
that should be done by processor j. 

Main Processing 

In the main processing, the algorithm proceeds bottom up. We first find the combin- 
ations of 1 elements to start the processing (base case of the recursive algorithm), then 
the combinations of 2 elements and so on. This processing finishes when we generate 
the relevant combinations of ^ elements. Finally, we generate the r-combi nations of n 
elements. This final step is done separately to get an optimal algorithm. Out of logn-f 1 
levels, the first logn levels are similar. They correspond to the for loop in our algorithm 
presented. So we describe the processing for an arbitrary level. 

Let us assume we are generating combinations for the i-th level; for i - th level, we will 
be generating combinations for 2’ elements. There will be two such sets of 2’ elements. 
More precisely we will be generating combinations for the first set {1, 2, , 2*} and the 
second set {2* + 1, 2‘ + 2,. . . ,2 ,+1 }. For the sake of simplicity let us denote 2’ by w. 
So, we are generating combinations for first w elements and the next w elements. We 
are generating p-combinations for w elements (and the other set of w elements) for p 
varying from 1 to min(w,r). 

From Eq. (7.10), we can observe that to generate the p-combi nations of w elements, 
we need the combinations from the two sets of elements, viz, the first set of f elements 
and the second set of — elements. Note that the lengths of the combinations that are 
needed from these two sets are same; The identity is symmetric in terms of first and 
second set of f elements. The following observation is quiet useful in such situations 
where we need the same lengths of the combinations for different sets of elements of 
same size. 

Observation: Suppose we have with us the all thep-combinations of the elements { 1, 2, . . . , n}, 
then to generate the p-combinations of the set of elements {b -F 1 , b + 2, . . . , b + n}, we add b 
to each element of each combination. 

Once we have the p-combinations of one set of elements the p-combinations of the 
adjacent set with the same size can be easily generated. One processor will be responsible 
for one element of a combination for the first set of w elements. So, that processor will 
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also add w to its value (which it is storing in its corresponding location) and stores that 
value in the corresponding location associated with the p-combi nations for the other set 
of elements. 

We now briefly describe how the processors are allocated and how they are doing 
their job. For each level, there are corresponding contiguous locations in the array 
Alloc. From the pre-processing we also know the number of processors that are needed 
for each level. For level i, we need D[ir(r + 1)] - D[(i - 1 )r(r + 1)] processors. 
So we allocate that many processors for a given level and the processors identify their 
work by consulting their assigned location in Alloc. Processor j is associated with the 
location j' = D[(i — l)r(r + 1)] + j of Alloc for level i. Once the processor knows 
to which part of the p-combinations it is allocated i.e Alloc\j'], and its number with 
respect to the processors that are allocated for a given part i.e, N\j'], the processor 
copies the information from the previous combinations calculated for the last level of 
processing. Suppose the processor is allocated to a part: C(f, k).C(f,p - k). Then 
C(j, k).C(j, p — k).p processors are needed for this part and these processors copy the 
Ar-combinations from the first set of j elements and p- ^-combinations from the second 
set of j elements. More precisely, we have to form p-combinations where the first k 
elements will be coming from the ^-combinations of the first set of f elements and the 
remaining p — k elements will be coming from the p — ^-combinations of the other set 
of j elements. So, there will be C(y, k).C(j,p — k ) p-combinations in all for all the 
possibilities. 

The locations where we store these p-combinations will be obtained from the array D. 
So, once a processor knows its number with respect to the part of the p-combinations, 
then it proceeds as follows. It first identifies the p-combination in which it is going 
to participate. Then it identifies whether it should retrieve an element from the k- 
combinations of first set of f elements or the p — ^-combinations of the second set 
0 f h elements. Then it identifies the corresponding element and puts the element in 
the location corresponding to it in the p-combinations corresponding to first set of w 
elements and it adds w to its element and writes that in the position corresponding to it 
in the p-combinations for the adjacent set of w elements. The combination a processor 
is associated with, the element the processor should retrieve and where the processor 
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should store are easy to get, once we have the information obtained from pre-processing. 

Regarding space allocation, we will have two four dimensional arrays. The first array 
will be for the first set of elements. The second array will be for the combinations cor- 
responding to the adjacent set of elements. The first dimension of the array correspond 
to the level of bottom up processing. The second dimension corresponds to the length 
of combinations, the third dimension correspond to the number of combination and the 
fourth dimension corresponds to the actual combinations elements. As an example, the 
element that corresponds to [4, 3, 5, 2] is the 2nd element of the the 5 th combination of 
the 3-combinations of the set of elements {1,2, . . . ,2 4 }, i.e {1,2,. .. ,16}. 

Till now we have explained how we are generating combinations for all the levels 
except the top level. Once we have come to this stage this means that we have generated 
all needed combinations for the first set of | elements and the second set of | elements. 
We have to generate the r-combinations of set of n elements from these combinations. 
We use the identity (7.11) for processor allocation. The processor allocation is similar 
to the way we have shown earlier in our Generic processor allocation (see Section 2.3). 
Thus, we can get our r-combinations for the n elements. 

We analyze the algorithm for time complexity and the work done. 

We first consider the pre-processing part of the algorithm. Initially we are calculating 
the values of binomial coefficients. This calculation is implemented by finding factorials 
of z! for 1 < i < n using prefix multiplication in O(logn) time with linear work[25]. 
Later we calculate the values of binomial coefficients in Step 4 in constant time with nr 
processors. 

Then we do processor allocation. In Step 5 we formulated the array C which is useful 
for processor allocation. The array C store the information for all the recursive calls that 
will be made in algorithm. The array C is based on Eq. (7.10). There are logn-1 levels 
in all corresponding to the levels of recursive calls. Each level has got rmn(p,r) calls 
in a level if we are generating combinations for p objects. But for simplicity the number 
of arrays we are filling here is r for each level. From Eq. (7.3), it follows that all the 
extra arrays and extra locations we are building up will contain zeroes. So, in the later 
processor allocation we won’t be allocating processors to them. Thus, the array C is of 
length (logn — l)r(r -f 1). Filling up C can be done in constant time with O(logn.r 2 ) 
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Pre-Processing 

1 for i = 1 to n in parallel do 

A[i] = i; 

2 Pref ix_mult (A) ; 

A[0] - 1; // 0! =1 

3 Calculate values of C(p,q) for l<p<n, 0<g<r; 

4 for q = 0 to r in parallel do 

for p = 1 to n in parallel do 
com [p , q] = A [p] /A [p-q] . A [q] ; 

Pre-Processing for Processor Allocation 

5 Create an array C of length, (logn — l)r(r + 1) . The locations 
[(i — l)r(r + 1)] + 1 to ir(r + 1) correspond to processor allocation 
details for level i. If a level i starts at position START then the 
processor allocation for generation of in-combinations out of 2 1 
objects corresponds to locations START + \{m — 1)(?“ + 1) + 1] to 
START+m(r+l) , where 1 < m < r. 

6 D = Prefix- sum (C) ; 

7 for i = 1 to (logn - l)r(r + 1) in parallel do 

start [i] = D[i-1]+1; 
size[i] = C[i] ; 
end [i] = start [i]+size[i]-l; 
p = D[(log n-l)*r*(r+l)] 

8 Generic_Processor_Allocation; 


Algorithm Generate_Combinations(n, r) 

Begin 

Generate 1-combinations of 1 object {1} and {2}; 
for i = 1 to logn - 1 do 

Generate all the combinations related to set of 2‘ 
objects and for an adjacent set of elements of the same size. 
Processor allocation details f Asf^the t0 P l eve ^» 



processors (Step 5). 

In Step 6, we are calculating the prefix sum of array C into D. This takes a time of 
0 (log (log n.r 2 )) i.e 0(loglogn + logr) with a work of 0(logn.r 2 ). 

In Steps 7 and 8, we are getting the data structure for processor allocation. Total 
is the final summation value in the prefix sums we have calculated above. In fact the 
Total will be nothing but total number of operations that should be performed in the 
algorithm except the top level. We later show that this value Total is bounded above by 
the expression 2.C(n,r).r (see Lemma 7.18). 

Step 7 takes constant time with 0(log n.r 2 ) processors. Generic processor allocation 
take a time of 0(log log *(7otal + log nr 2 ))) with 0(logn.r 2 + Total ) work on CREW 
PRAM (see Theorem 2.3). i.e time complexity is 0(loglog*(n r+1 ), i.e 0(loglog*n + 
log log *r). 

Thus entire pre-processing takes a time of O(logn). The work done is 0{C{n,r).r- (- 
log n.r 2 + nr) i.e, 0(C(n, r)r). 

Lemma 7.18 Ifn = 2 k for some integer k and l < r < | then E;=o Ej=o (2 ’ r) C(2\j).j < 
2.C(n,r).r 


Proof: The proof is by induction on k. We apply the basis when n — 2 and for all 
applicable values of r i.e, when k = 1. 

Initially consider n = 2 and r = 1. It is obvious that 
C(l,0).0 + C'(l,l).l = 1 <4 = 2.C(2 1 l).l 

Thus, basis is proved. 

As part of induction hypothesis we assume that the lemma is valid for all n and for 
l<r<f. 

Let us consider the case when we are looking at 2n and for various values of r. We 
divide the proof into two cases. Note that 1 < r < n and 2n = 2 fc+1 . 

Let LHS = Eto£r=o (2V> 0{2\j).j 


Case r < 


So, LBS. s±o E”: <2 ' ' •> C{*M = SB eS (2V) 

In the above expression, consider the first part of the expression, for that all the 
assumptions of hypothesis are valid as n is a power of 2 and r > 1 and r < f and hence 
by induction hypothesis, 
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LHS < 2-C(n,r).r + ZUoC(n,j).j 

From Eq. (7.11), E, r „o C(n, j).j < C( 2n,r).r as r <n. Hence, 

LHS < 2.C(n,r).r + C(2n, r).r 

Consider 


C(2n,r)/C(n,r) = _(^ )(2n - 1) (2n-r + l) 

(n)(n — l)(n — 2) (n — r + 1) 


(7.13) 


As r > 1, it follows that C{2n,r)/C(n,r) > 2, Thus, C(2n,r) > 2 .C(n,r). 

So, LHS < 2.C(n, r).r + C(2n, r).r < C(2n, r).r + C{ 2n, r).r = 2.C'(2n, r).r 

Hence the lemma is valid for this case. 

Case r > 

Recall that r < n. 

Since r > it follows that 

LHS = ELo r) = Efc? E™: (2i,r) C(2‘, C(2*,j).. 

ZjU C(2\j).i + e;„ 0 C(2\ i).j = Efc 1 e5 (2 ' ,?) C(V,j).j + E ',0 C(n,i).j 

since r < n, it follows that min(n, r) = r. 

By using induction hypothesis, with r — it follows that 

£ffS<2.C( n ,J).f+I3 - C(n,j)j 
2.C(n,|)<C(2n,f)byEq. (7.13). 

From Eq. (7.5), C'(2n,|) < C(2n, r) a s r < n and r > j. 

Since f < r and using the above assertion, 

LHS < C(2n,r).r + £J =0 C(n, j).j 

From Eq. (7.11), the second term is less than or equal to C(2n.r).r. 

Hence, LHS < C(2n, r).r + C(2n, r).r = 2.C'(2n, r).r 

As, the lemma is valid in this case also, the lemma is proved. I 

We now take up the analysis of main processing. For the level i, we generate 
combinations of 2‘ objects. We generate the ^-combinations of these objects where 
1 < p < min(2\r). More over we generate the combinations for two such adjacent 
sets. 

Each level takes constant time. We count one operation as storing or obtaining an 
item of any combination. The generation of a single combination takes the number of 
operations equal to the length of the combination. So, the number of operations in level 
i are 
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2ES ,r ' 2 ‘ ) C(2 i ,;)-j] 

We have logn levels, excluding the top level. Hence the sum of operations of all 
these levels put together is 

2E& C(2‘,i).j] where n = 2‘. 

From Lemma 7.18, the above sum is bounded above by A.C(n,r).r. 

Since there are log n levels in all each level taking constant time. The time for this 
part is O(logn). 

For top level, we allocate the processors by means of Generic processor allocation 
problem (see Section 2.3) using Eq. (7.11). This is similar to processor allocation in 
pre-processing. 

So, processor allocation takes a time of 0(loglog*n + log log *r) time and the 
number of operations are 0(C(n,r).r). This step requires CREW PRAM. 

Now, we consider the generation of r-combinations of n objects at the top level. This 
step takes constant time. The number of operations are 0(C(n, r).r). 

We summarize in the following theorem. 

Theorem 7.19 The algorithm runs optimally with a time of 0(\ogn) and the work is 
0(C(n, r).r) on the CREW PRAM when r < | and n is a power of 2. I 

7.4.2 Generalization of the Algorithm 

In the earlier section, we have seen the algorithm to generate the r-combinations of n 
objects where n is a power of 2 and r < f . In this section, we will remove the first 
restriction of that algorithm viz. n is a power of 2. We will generate the r-combinations 
of n elements where r < f . The algorithm in this section heavily makes use of our 

earlier algorithm. 

Like our earlier algorithm, this algorithm is also based on special cases of Vander- 
monde's convolution. We are interested in generating r-combinations of n elements. Let 
k is the maximum integer such that 2 k < n. Since n is not a power of 2, 2 k < n. From 
now onwards let us denote 2 k by m. In fact m is the most significant bit in the binary 

representation of n. 

Let n 2 = n - n x . Observe that > [|j and n 2 < [f J- 


140 



We would like to generate the r-com binations of n objects by first generating combin- 
ations for n x objects. From the combinations of m objects {1,2, . . . ,m}, we will get the 
combinations for 77.2 objects {ni + 1 , . . . , n}. By combining together these combinations 
using Vandermonde's convolution, we get the r-combinations of n objects. 

Depending on the value of r with respect to the value of ri 2 , we have two cases. 
Case 1: n 2 > r 

The following identity is a special case of Vandermonde’s convolution Eq. (7.9) when 
m x = n x and m 2 = n 2 . 


^C'(n 1 ,i).C'(n 2 ,r-i) = C(n,r) (7-14) 

»=o 

Thus, we need to generate the p-combinations for n x objects {1,2,. . . ,ni} and n 2 
objects {ni + 1, . . . , n} where 0 < p < r. 

The algorithm is given below. 

1 Do Pre-processing and generate combinations for 1 ,2, . . .n x /2 elements. 
Pre-processing involves solving processor allocation problem. 

2 Do Processor allocation for generating p- combinations of n x elements 
{1,2, where p varies from 1 to r; 

3 Generate p-combinations of n x elements 
{1,2, ...,nx) where p varies from i to r; 

4 Generate p-combinations of n x elements 

{ni + l,n I + 2,...,2ni} where p varies from 1 to r; 

5 Assuming n ■+ 1, ...,2ni as dummy elements, rank the above combinations 
to obtain the p-combinations of n 2 elements {n x + l,nx +2,..,n} where 

p varies from 1 to r; 

6 Generate the r-combinations of n objects. 
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We initially do the pre-processing, so that assuming we are generating the r-combinations 
of n x objects. Since n x is a power of 2, we will do this is in the same manner as we have 
done for the previous algorithm. Thus, we have got the p-combinations for m elements 
where m is a power of 2 and m < n x and p varies from 0 to min(m , r). 

We now do the processor allocation to generate p-combi nations for n x elements 
{1,2,.. . ,n x } where p varies from 1 to r. This processor allocation is based on the 
Eqs. (7.11) and (7.12) and using Generic processor allocation (see Section 2.3). 

So, using the processor allocation we generate the p-combinations for n x elements 
{1,2, ...,n x } where 1 < p < r. Then, we generate the p-combinations for n x ele- 
ments {n\ + l,n x + 2, . . . ,2.n x } where p varies from 1 to r as follows. We copy the 
p-combinations for re x elements {1,2,..., n x } adding rc x to each element of the combin- 
ation. 

We have to generate the p-combinations of n 2 elements {n x + 1, .. .,n} where 1 < 
p < t using the above combinations. Assume that the elements {n-fT, n-f2, . . . , 2.n x } as 
dummy elements. We identify all those combinations which consist of at least one dummy 
element. The remaining combinations are just the p-combinations of the n 2 elements 
{n x + 1, . . . ,n} where p varies from 1 to r. But to get these combinations together, 
we use ranking. We rank all the valid combinations using the procedure described in 
Section 7.3.1. At the end of this processing we have got all the needed p-combinations 
of n 2 elements {n x + 1, . . . , n} where p varies from 1 to r. 

Once we have generated the p-combinations for n x elements {1, 2, . . . , n x } and {n x 4- 
1, . . . , n}, we can easily generate the r-combinations of n objects {1,2, . . . , n} using the 
identity (7.14). 

We analyze the algorithm. Note that n 2 > r. 

Lemma 7.20 Step 1 takes a time ofO ( log n) with 0{C(n, r)r) work on CREW PRAM. 


Proof: In Step 1 we are doing the pre-processing for the processor allocation. The work 
for the pre-processing and the later generation of combinations is same. But the time is 
different; combination generation takes O(logn) time but pre-processing time depends 

on the work. 
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After the pre-processing is over, we generate the combinations for l,2,...,n 1 /2 
elements. The number of operations are 

/-_! min(2\r) 

s = 2[£ E (7.15) 

*=' 0 j =0 

where we assumed that ni = 2 k for some integer k. 

S can be bounded as follows. We consider two cases, 
case 1: r > n\/2 

In this case S can also be written as follows. 

S = 2.[j:£lZl 0 C(2 i ,j).j} 

This can be bounded as4.0(ni, ni/2).ni/2 (see Lemma 7.18). But since C(n lri nj/2) < 
C(n,ni/ 2) < C(n,r ) (as r < |). Hence it follows that S can be bounded by 
0(C(n,r).r). 
case 2: r < n x /2 

S can be directly bounded by a direct application of Lemma 7.18. The S is bounded 
by 4.C(ni, r).r. 

But since C(rii,r ) < C(n,r), it follows that S is bounded by 0(C(n, r).r). 

Thus, pre-processing has the cost 0(C(n,r).r). So, the time is O(log log *(C(n, r).r)) 
which is 0 (log log *n + log log *r). The lemma follows. I 

In Step 2 and 3, we are generating the p-combinations for elements where p varies 
from 1 to r. This takes a time of O(loglog*n + loglog*r). This is the time taken for 
pre-processing. The generation of the combinations per se, takes constant time. The 
number of operations are 
£i=i C(n u i).i 

From the Eq. (7.14), the above summation is bounded by 0(C{n,r).r). 

In Step 4 we are generating the p-combinations for n x elements {nj + 1, • . • , 2^}. 
This takes a time of 0(1) and the number of operations are same as above. 

In Step 5, we are generating the p-combinations for n 2 elements by means of ranking 
where p varies from 0 to r. From Section 7.3.1, we know that ranking a p-combination 
takes a time of O(logp) and 0(p) work. Hence we generate the needed p-combinations 
in a time of O(logn) and with a work of 0(C(n,r).r). 
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Later we are generating the r-combinations of n elements. This is based on Eq. (7.14) 
and hence it takes a time of 0(loglog *n+loglog *r) (Note that we have to do processor 
allocation). The generation of the r-combinations per se, takes constant time with a work 
of 0(C(n,r).r). We summarize our above discussion in the following lemma. 

Lemma 7.21 The algorithm takes a time of 0 (log n) with optimal work 0(C(n,r).r) 
on the CREW PRAM with the condition that n 2 > r and r < |. 1 

Case 2: ra 2 < r 

In this case we aim at eliminating the zero terms from identity (7.14) to get 

n 2 

^0(ni,r-i).C(n 2 ,i) = C(n,r) (7.16) 

»=o 

Note that since ni > [|] and r < [|], it follows that n j. > r. So, in other words we 
need to generate the p-combinations for n x objects {1,2, where p varies from 

r — n 2 to r and p-combinations for n 2 objects {ni + 1, . . . ,n} where p varies from 0 to 
n 2 . The algorithm is given below. 

1 Do Pre-processing and generate combinations for 1,2, ...,ni/2 elements. 
Pre-processing involves solving processor allocation problem. 

2 Do Processor allocation for generating p-combinations of n\ elements 
{l,2,...,ni} where p varies from r - n 2 to r; 

3 Generate p-combinations of nj elements 
{l,2,...,ni} where p varies from r - n 2 to r; 

4 Generate p-combinations of ni elements 

{n 1 + l,ni + 2,...,2n 1 } where p varies from 0 to n 2 ; 

5 Assuming n + l,..,2ni as dummy elements, rank the above combinations 
to obtain the p-combinations of n 2 elements {nj + 1, n x + 2, ..,n} where 
p varies from 0 to n 2 ; 
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6 Generate the i combinations of n objects. 


We initially do the pre-processing assuming we are generating the r-combinations of 
n x objects. Since is a power of 2, the way we will do this is same as earlier we have 
done for the previous algorithm. Once this is done, we have got the p-combinations for 
m elements where m is a power of 2 and m < nj and p varies from 0 to min(m,r). 

We next do the processor allocation to generate p-combinations for elements 
{1,2, .. . , n : } where p varies from r — n 2 to r. This processor allocation is based on 
the Eqs. (7.11) and (7.12) with appropriate special cases of that identities and using 
Generic processor allocation (see Section 2.3). So, using the processor allocation we 
generate the p-combinations for n x elements {1,2,..., n x } where p varies from r — n 2 

to 7". 

In a similar way, we generate the p-combinations for ni objects {1,2, . . . ,n x } where 
p varies from 1 to n 2 . From these we generate the p-combinations for n i objects {nj + 

1 , 2.71].}, by copying the p-combinations for n x elements 1,2,..., adding to 

each element of the combination. 

From these combinations, we generate the p-combinations of n 2 elements {7i x + 
1 ? ... ,72} where p varies from 1 ton 2 . We assume that the elements n + l,ra + 2, . . . ,2.7ii 
as dummy elements. VVe identify all those combinations which consist of at least one 
dummy element. All the remaining combinations are just the p-combinations of the n 2 
elements {ni + 1 , . . . ,n} where p varies from 0 to n 2 . To get these needed combina- 
tions together, we use ranking. We rank all the valid combinations using the procedure 
described in Section 7.3.1. By the end of this processing we have got all needed p- 
combinations of n 2 elements {m + 1 , . . . , n} where p varies from 1 to n 2 . 

Once we have generated the p-combinations for n x elements {1,2,..., Tix) where p 
varies from r — n 2 to r and p-combinations for n 2 objects {ni + 1,. . . ,7*} where p varies 
from 0 to n 2 , we can easily generate the r-combinations of n objects {1,2, ... ,n} using 

the identity (7.16). 

We analyze the above algorithm noting that n 2 < r. 

Step 1, takes a time of O(log77) with 0(C(n, r)r) work (see Lemma 7.20). 
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In Steps 2 and 3, we are generating the ^-combinations for n\ elements where p 
varies from r — n 2 to r. This takes a time of O(loglog*n + log log *r), the time taken 
for pre-processing. The generation of the combinations per se takes constant time. The 
number of operations are 

£i=r-n 2 C(n u i).i 

From Eq. (7.16), the above summation is bounded by 0(C(n, r).r). 

In Step 4 we are generating the p-combinations for n x elements + 1, . . . , 2.n x }. 
This takes a time of 0(log log *n -flog log *r) (pre-processing for processor allocation) 
and the number of operations are: 

5 = E2 0 C(ni > »).< 

The following combinatorial identity is a special case of Eq. (7.9) 

TJii 0 C(n u i).C(n 2 ,n 2 - i) = C(n,n 2 ) 

It follows that S is bounded by 0(C(n,n 2 ).n 2 ). But since C(n,n 2 ) < C(n,r) ( 
since n 2 < r and r < |). S is bounded by 0(C(n,r).r). 

In Step 5, we are generating the p-combinations for n 2 elements by means of ranking 
where p varies from 0 to n 2 . From Section 3.2 we know that ranking a p-combination 
takes a time of O(logp) and <3(p) work. Hence we generate the needed p-combinations 
in a time of O(logn) and with a work of 0(C(n,r).r). 

We then generate the r-combinations of n elements. This is based on Eq. (7.16) and 
it takes a time of 0(loglog*n + log log *r) (we have to do processor allocation). The 
generation of the r-combinations per se takes constant time with a work of 0(C(n , r).r). 
We summarize our above discussion in the following lemma. 

Lemma 7.22 The algorithm takes a time of 0(log n) with optimal work 0(C(n,r).r ) 
on the CREW PRAM with the condition that n 2 <r and r < |. I 

By combining our earlier two lemmas, we obtain the following theorem. 

Theorem 7.23 The algorithm can generate the r-combinations ofn objects with a time 
complexity of O(logn) and optimal 0(C(n,r).r) work on the CREW PRAM whenr < |. 

I 
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7.4.3 CASE r > f 

Now we are going to remove the last remaining restriction of earlier algorithm viz. r < |. 
The way we remove this is similar to we have done for our preceding algorithm. (see 
Section 7.3) 

If r > j, then note that n—r < j. So we initially generate the n— r-combi nations of n 
objects using the earlier algorithm described above. Later on for each n—r combination, 
we generate its corresponding r-combination using prefix sums in a straight forward way. 
Hence this leads to the following theorem (Note that n is 0(r ) when r > |), 

Theorem 7.24 The algorithm will generate the r -combinations ofn objects with a time 
complexity of O(logn) and optimal work 0(C(n, r).r) on CREW PRAM. I 

7.4.4 Generation of Combinations Lexicographically 

The above algorithm does not generate the combinations in lexicographic order. But we 
can easily remedy this. We rank each combination to get its rank in lexicographic order. 
This can be done in O(logr) time with 0(r) work for each r-combination. So this leads 
to the following theorem. 

Theorem 7.25 The algorithm will generate the r-combi nations ofn objects in lexico- 
graphic order with a time complexity of O(logn) and optimal work 0(C(n,r).r) on 
CREW PRAM. 
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Chapter 8 
Conclusions 


Our algorithms for the generation of combinatorial objects can be classified into two 
types — linear time algorithms and poly-logarithmic time algorithms. The linear time 
algorithms are derived using the construction of combinatorial trees. The concept of 
combinatorial tree we have defined, is very general and we believe its use extends beyond 
the present thesis. It can as well be a starting point for deriving new algorithms for 
similar combinatorial problems. The poly-logarithmic time algorithms are derived using 
divide-and-conquer paradigm. In general our algorithms are derived by giving algorithmic 
interpretation to well known combinatorial identities. This approach looks very promising 
for deriving parallel algorithms for combinatorial generation problems and needs to be 
explored further. 

Note that our poly-logarithmic algorithms for generation of permutations and combin- 
ations are such that depending on the relative values of r and n, the r-recursive algorithm 
will be faster for some range and the n-recursive algorithm will be faster for the other 
range. It will be a good idea to design an algorithm which integrates the features of both 
these algorithms. 

In the remaining part of this chapter, we will concentrate on the open problems in 
combinatorial generation. For the generation of permutations, we have looked at the ba- 
sic problem of generating r-permutations of n objects. There are a number of variations 
and extensions to this problem for which no parallel algorithms are available on PRAM. 
They include the generation of: permutations with restricted repetitions, permutations 
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with unrestricted repetitions (variations), rosary permutations, cyclic permutations, al- 
ternate permutations, and permutations with fixed number of cycles (Stirling numbers). 
In the case of combinations also we have looked at the basic problem of generating 
r-combinations of n objects. The related open problems include the generation of: com- 
binations with repetitions and gray codes. 

There are a number of other problems in combinatorial generation which we have 
not touched upon and are awaiting parallel algorithms. They include the generation of: 
compositions with and without restrictions, and partitions with and without restrictions. 
Closely related to combinatorial generation are graphical enumeration problems. In this 
field also there are lot of problems for which no parallel algorithms are known. We believe 
our techniques can be applied to these problems because of their general nature. 

Throughout the thesis, our concentration has been on the generation of combinatorial 
objects in lexicographic order. There is another well known order, minimal change 
order[ 16], which also has got important practical applications. It is a good idea to extend 
the algorithms to generate the combinatorial objects in this order. In general to generate 
the combinatorial objects in an orderly manner, ranking and unranhng functions are 
needed. But for most of the problems, we mentioned above, the ranking and unranking 

functions are yet to be designed. 

In the thesis, our emphasis has been on the generation of all combinatorial objects. 
An important variation of this approach is uniform generation of a random combinatorial 
object. This has also got large number of applications. For most of the problems men- 
tioned above, no parallel algorithms are known for random generation of combinatorial 


objects. 

Practically no non-trivial lower bounds for time are known for the generation of 
combinatorial objects. Hence it remains to be seen whether our algorithms can be 
improved (in terms of PRAM model or time or both) or they can be shown to be time 

We showed that given permutations in lexicographic order, we can generate the 
rangements in lexicographic order. That is, getting improved algor, thms for generatmg 
permutations has added advantage of automatically providing improved algor, thms for 
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generating derangements. We have not shown that permutation generation and derange- 
ment generation are equivalent. It will be interesting to understand the relationship 
between these problems more deeply. 

The approach we have presented for generating derangements from permutations can 
be cast in a much more broader perspective. Similar idea works in a situation where we 
are given set of combinatorial objects and we would like to obtain a subset of these 
elements which satisfy certain restrictions. 


150 



Bibliography 


[1] Akl, S. G. A new algorithm for generating derangements. BIT 20 (1980), 2-7. 

[2] AKL, S. G. Adaptive and optimal parallel algorithms for enumerating permutations 
and combinations. The Computer Journal SO, 5 (1987), 433-436. 

[3] AKL, S. G. The Design and Analysis of Parallel Algorithms. Prentice Hall, 
Englewood Cliffs, New Jersey, 1989. 

[4] Akl, S. G., GriES, D., and Stojemenovic, I. An optimal parallel algorithm 
for generating combinations. Information Processing Letters 33 (1989), 135-139. 

[5] Akl, S. G., Meijer, H., and Stojmenovic, I. An optimal systolic algorithm 
for generating permutations in lexicographic order. Journal of Parallel and Dis- 
tributed Computing 20, 1 (1994), 84-91. 

[6] ANDERSON, G., AND Miller, G. L. Parallel deterministic list ranking. Al- 
gorithamica (1988), 770-785. 

[7] BELLMAN, R., Cooke, and Lockett. Graphs, Algorithms and Computers. 
Academic Press, New York, 1970. 

[8] BERKMAN, O. Paradigms for Very Fast Parallel Algorithms. PhD thesis, Dept, 
of CSE, Tel Aviv University, Tel Aviv, Israel, 1991. 

[9] Bhatt, P. C. P., Diks, Hagerup, T., Radzik, Prasad, V. C., and 
SAXENA, S. Improved parallel deterministic integer sorting. Information and 
Computation 94 (1991), 29-47. 


151 



[10] Chan, B., and Akl, S. G. Generating combinations in parallel. BIT (1986), 
6-10. 

[11] CHEN, G. H., and Chern, M. Parallel generation of permutations and combin- 
ations. BIT 26, 3 (1986), 277-283. 

[12] COLE, R. Parallel merge sort. SIAM Journal on Computing 17, A (1988), 
770-785. 

[13] CORMEN, T. H., Leiserson, C. E., AND Rivest, R. L. Introduction to 
Algorithms. MIT Press, Cambridge, MA and McGraw-Hill, New York, 1990. 

[14] Deo, N. Graph Theory: With Applications to Computer Science and Engin- 
eering. Prentice Hall, Englewood Cliffs, New Jersey, 1974. 

[15] Djokic, B., Miyakawa, M., Sekiguchi, S., Semba, I., and Stojmenovic, 
I. Parallel algorithms for generating subsets and partitions. In Lee. Notes in Comp. 
Sc., SIGAL (1990), vol. 450. 

[16] Even, S. Algorithmic Combinatorics. Prentice Hall, Englewood Cliffs, New 
Jersey, 1989. 

[17] FORTUNE, S., and WYLLIE, J. Parallelism in random access machines. In Proc. 
of 10 th ACM Symp. on Theory of Comp. (1978). 

[18] GHOSH, R. K., Moona, R., and Gupta, P. Foundations of Parallel Pro- 
cessing. Narosa, New Delhi, 1995. 

[19] GIBBONS, A., AND Rytter, W. Efficient Parallel Algorithms. Cambridge 
University Press, Cambridge, 1988. 

[20] Graham, R. L., KnutH, D. E., AND PATASHNIK, O. Concrete Mathematics: 
A Foundation for Computer Science. Addison Wesley Publishing Co., Reading, 
Mass., 1989. 

[21] Gupta, P., and Bhattacharjee, G. P. Parallel generation of lexicographic 
combinations. In Conference Record of Foundations of software Technology and 
Theoretical Computer Science (1981), pp. 193-200. 


152 



[22] Gupta, P., AND Bhattacharjee, G. P. Parallel generation of permutations. 
The Computer Journal 26, 1 (January 1983), 97-105. 

[23] GUPTA, P., AND Bhattacharjee, G. P. A parallel derangement generation 
algorithm. BIT 29 (1989), 14-22. 

[24] HAGERUP, T., AND Shen, H. Improved non-conservative sequential and parallel 
integer sorting. Information Processing Letters 36 (1990), 57-63. 

[25] JAJA, J. An Introduction to Parallel Algorithms. Addison Wesley, Reading, 
Mass., 1992. 

[26] KNUTH, D. E. Fundamental Algorithms, 2 ed., vol. 1, The Art of Computer 
Programming. Addison Wesley Publishing Co., Reading, Mass., 1973. 

[27] KNUTH, D. E. Sorting and Searching, 2 ed., vol. 3, The Art of Computer 
Programming. Addison Wesley, Reading, Mass., 1973. 

[28] LEHMER, D. H. The machine tools for combinatorics. In Applied Combinatorial 
Mathematics, E. F. Backenbach, Ed. John Wiley, 1964, ch. 1. 

[29] LEIGHTON, F. T. An Introduction to Parallel Algorithms and Architectures: 
Arrays, Trees, Hypercubes. Addison Wesley, Reading, Mass., 1992. 

[30] LlU, C. L. Introduction to Combinatorial Mathematics. McGrawHill, New York, 
1968. 

[31] LOVASZ, L. Combinatorial Problems and Exercises, 2 ed. Elsevier Science, 
Amsterdam, 1993. 

[32] MANBER, U. Introduction to Algorithms: A Creative Approach. Addison Wesley 
Publishing Co., Reading, Mass., 1989. 

[33] NlJENHUIS, A., and WlLF, H. S. Combinatorial Algorithms: for Computers 
and Calculators, 2 ed. Academic Press, New York, 1978. 


153 



[34] Rajan, V., Gupta, P., AND Ghosh, R. K. Parallel generation of combina- 
tions and permutations. In National Symposium in Theoretical Computer Science 
(1991). 

[35] RAJASEKARAN, S., AND Reif, J. H. Optimal and sub-logarithmic time ran- 
domized parallel sorting algorithms. SIAM Jornal on Computing 18, 3 (1989), 
594-607. 

[36] Reingold, E. M., Nievergelt, J., and Deo, N. Combinatorial Algorithms: 
Theory and Practice. Prentice Hall International, Englewood Cliffs, New Jersey, 
1977. 

[37] RlORDAN, J. An Introduction to Combinatorial Analysis. John Wiley & Sons, 
1958. 

[38] SEDGEWICK, R. Permutation generation methods. ACM Computing Surveys 19, 
2 (1977), 137-164. 

[39] SPRINGSTEEL, F., AND Stojmenovic, I. Parallel general prefix computations 
with geometric, algebraic, and other applications. International Journal of Parallel 
Programming 18, 6 (1989), 485-503. 

[40] SvED, M. Counting and recounting. The Mathematical Intelligencer 5, 4 (1983), 
21-26. 

[41] Tsay, J. C., and Lin, C. J. A systolic design for generating combinations in 
lexicographic order. Parallel Computing 26, 2 (1992), 6—10. 

[42] VELLEMAN, J. How to Prove It. Cambridge University Press, 1993. 

[43] WlLF, H. S. The "why don’t you just ....?” barrier in discrete algorithms. Amer- 
ican Mathematical Monthly 86 (1979), 30-36. 


154 



lwj-- 



Date 


123434 


This book Is tdbfbiireturiiftd oft the 
date last stamped. 




